2021-04-14T11:00:34.959Z [main] WARN o.o.s.c.util.YamlToObjectConverter RequestID=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= The file /var/lib/jetty/config/catalog-be/neo4j-errors-configuration.yaml cannot be found. Ignore reading configuration. 2021-04-14T11:00:35.091Z [main] INFO o.o.s.be.listen.BEAppContextListener RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ASDC version from MANIFEST is 1.8.4 2021-04-14T11:00:35.136Z [main] INFO o.o.s.b.m.BeMonitoringService RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= BE monitoring service is disabled 2021-04-14T11:00:35.137Z [main] INFO o.s.web.context.ContextLoader RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Root WebApplicationContext: initialization started 2021-04-14T11:00:37.187Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ** JanusGraphClient created 2021-04-14T11:00:37.191Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ** createGraph started ** 2021-04-14T11:00:37.191Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ** open graph with /var/lib/jetty/config/catalog-be/janusgraph.properties started 2021-04-14T11:00:37.191Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= openGraph : try to load file /var/lib/jetty/config/catalog-be/janusgraph.properties 2021-04-14T11:00:37.554Z [main] INFO com.datastax.driver.core RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= DataStax Java driver 3.8.0 for Apache Cassandra 2021-04-14T11:00:37.559Z [main] INFO c.d.driver.core.GuavaCompatibility RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-04-14T11:00:38.132Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Using native clock to generate timestamps. 2021-04-14T11:00:38.324Z [main] INFO com.datastax.driver.core.NettyUtil RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Found Netty's native epoll transport in the classpath, using it 2021-04-14T11:00:39.271Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-04-14T11:00:39.272Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host cassandra.onap/10.242.198.206:9042 added 2021-04-14T11:00:39.272Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host /10.242.62.131:9042 added 2021-04-14T11:00:39.273Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host /10.242.70.81:9042 added 2021-04-14T11:00:39.710Z [main] WARN o.j.g.c.GraphDatabaseConfiguration RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Local setting storage.cql.replication-strategy-options=[Pod, 3] (Type: FIXED) is overridden by globally managed value ([Pod, 3]). Use the ManagementSystem interface instead of the local configuration to control this setting. 2021-04-14T11:00:41.770Z [main] INFO o.j.g.c.GraphDatabaseConfiguration RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Generated unique-instance-id=0af23e92251-dev-sdc-be-59c76dbb57-hpl5m1 2021-04-14T11:00:41.783Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Using native clock to generate timestamps. 2021-04-14T11:00:42.085Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-04-14T11:00:42.085Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host cassandra.onap/10.242.198.206:9042 added 2021-04-14T11:00:42.085Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host /10.242.62.131:9042 added 2021-04-14T11:00:42.085Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host /10.242.70.81:9042 added 2021-04-14T11:00:42.358Z [main] INFO org.janusgraph.diskstorage.Backend RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Initiated backend operations thread pool of size 2 2021-04-14T11:00:43.061Z [main] INFO o.j.diskstorage.log.kcvs.KCVSLog RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Loaded unidentified ReadMarker start time 2021-04-14T11:00:43.061715Z into org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller@59cbeaee 2021-04-14T11:00:43.217Z [main] INFO o.o.s.b.d.j.JanusGraphClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ** JanusGraph graph created 2021-04-14T11:00:44.856Z [main] INFO o.o.s.b.d.j.JanusGraphGenericDao RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ** JanusGraphGenericDao created 2021-04-14T11:00:44.860Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:00:45.121Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= All sdc keyspaces are : [sdcartifact, sdcrepository, sdcaudit] 2021-04-14T11:00:45.122Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Connecting to node: [cassandra.onap] port: 9042. 2021-04-14T11:00:45.123Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Connection timeout in seconds : 120 2021-04-14T11:00:45.123Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= SocketConnectTimeout was provided, setting Cassandra client to use SocketConnectTimeout: 20000 . 2021-04-14T11:00:45.123Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= SocketReadTimeout was provided, setting Cassandra client to use SocketReadTimeout: 20000 . 2021-04-14T11:00:45.123Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= localDatacenter was provided, setting Cassndra clint to use datacenter: Pod as local. 2021-04-14T11:00:45.123Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Using native clock to generate timestamps. 2021-04-14T11:00:45.123Z [main] INFO o.o.s.b.d.c.schema.SdcSchemaUtils RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ** cluster created 2021-04-14T11:00:45.123Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= creating cluster for Cassandra Health Check. 2021-04-14T11:00:46.041Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-04-14T11:00:46.042Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host cassandra.onap/10.242.198.206:9042 added 2021-04-14T11:00:46.042Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host cassandra.onap/10.242.62.131:9042 added 2021-04-14T11:00:46.043Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= New Cassandra host cassandra.onap/10.242.70.81:9042 added 2021-04-14T11:00:46.043Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Cluster Metadata: com.datastax.driver.core.Metadata@45bde54d 2021-04-14T11:00:46.044Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= keyspace : sdcartifact , replication: {Pod=3, class=org.apache.cassandra.locator.NetworkTopologyStrategy} 2021-04-14T11:00:46.044Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= keyspace : sdcrepository , replication: {Pod=3, class=org.apache.cassandra.locator.NetworkTopologyStrategy} 2021-04-14T11:00:46.045Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= keyspace : sdcaudit , replication: {Pod=3, class=org.apache.cassandra.locator.NetworkTopologyStrategy} 2021-04-14T11:00:46.045Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= maxReplication Factor is: 3 2021-04-14T11:00:46.045Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= localQuorum is: 2 2021-04-14T11:00:46.046Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName= TargetServiceName=null ErrorCode=900 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= Health Check formula : Replication Factor – Local_Quorum = 1 2021-04-14T11:00:46.070Z [main] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ECOMP Portal health check configuration is missing. 2021-04-14T11:00:46.085Z [main] INFO o.o.s.b.s.d.SwitchoverDetector RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Enter init method of SwitchoverDetector 2021-04-14T11:00:46.086Z [main] INFO o.o.s.b.s.d.SwitchoverDetector RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null switchover detector service is disabled 2021-04-14T11:00:46.840Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null creating cluster for Cassandra for monitoring. 2021-04-14T11:00:46.840Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null The cassandra session is com.datastax.driver.core.SessionManager@67cc5a38 2021-04-14T11:00:46.840Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null The number of cassandra nodes is:3 2021-04-14T11:00:46.842Z [main] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null The cassandra down nodes number is 0 2021-04-14T11:00:50.532Z [main] INFO o.o.s.be.dao.jsongraph.JanusGraphDao RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ** JanusGraphDao created 2021-04-14T11:00:51.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a432cee-6376-4149-9cbe-fd0af0e46997 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:00:51.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a432cee-6376-4149-9cbe-fd0af0e46997 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d1a8fad 2021-04-14T11:00:51.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a432cee-6376-4149-9cbe-fd0af0e46997 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:00:51.339Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a432cee-6376-4149-9cbe-fd0af0e46997 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:00:52.856Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null SocketConnectTimeout was provided, setting Cassandra client to use SocketConnectTimeout: 20000 . 2021-04-14T11:00:52.856Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null SocketReadTimeout was provided, setting Cassandra client to use SocketReadTimeout: 20000 . 2021-04-14T11:00:52.856Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null localDatacenter was provided, setting Cassndra clint to use datacenter: Pod as local. 2021-04-14T11:00:52.857Z [main] INFO c.datastax.driver.core.ClockFactory RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Using native clock to generate timestamps. 2021-04-14T11:00:52.857Z [main] INFO o.o.s.b.d.cassandra.CassandraClient RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ** CassandraClient created 2021-04-14T11:00:53.867Z [main] INFO c.d.d.c.p.DCAwareRoundRobinPolicy RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Using provided data-center name 'Pod' for DCAwareRoundRobinPolicy 2021-04-14T11:00:53.867Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null New Cassandra host cassandra.onap/10.242.198.206:9042 added 2021-04-14T11:00:53.867Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null New Cassandra host cassandra.onap/10.242.62.131:9042 added 2021-04-14T11:00:53.867Z [main] INFO com.datastax.driver.core.Cluster RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null New Cassandra host cassandra.onap/10.242.70.81:9042 added 2021-04-14T11:00:54.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919827c4-91d9-4f19-839d-f6e471a71ba0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:00:54.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919827c4-91d9-4f19-839d-f6e471a71ba0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73683fc6 2021-04-14T11:00:54.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919827c4-91d9-4f19-839d-f6e471a71ba0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:00:54.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919827c4-91d9-4f19-839d-f6e471a71ba0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:00:55.129Z [main] INFO o.o.s.b.d.c.AuditCassandraDao RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ** AuditCassandraDao created 2021-04-14T11:00:55.277Z [main] INFO o.o.s.b.c.d.e.DmaapClientFactory RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:00:55.353Z [main] ERROR o.o.s.be.catalog.impl.DmaapProducer RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:00:57.296Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36730c98-5772-4f70-8355-508c2f4376aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:00:57.296Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36730c98-5772-4f70-8355-508c2f4376aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@633cf97a 2021-04-14T11:00:57.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36730c98-5772-4f70-8355-508c2f4376aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:00:57.297Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36730c98-5772-4f70-8355-508c2f4376aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:00:57.386Z [main] INFO o.o.s.b.d.c.ArtifactCassandraDao RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ** ArtifactCassandraDao created 2021-04-14T11:00:58.916Z [main] INFO o.o.s.b.d.c.SdcSchemaFilesCassandraDao RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ** SdcSchemaFilesCassandraDao created 2021-04-14T11:00:59.193Z [main] WARN o.o.s.b.c.s.CertificateManagerImpl RequestID=08bf5a0b-ae95-400d-a802-cae44a3cac84 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=SDC catalog TargetServiceName=null ErrorCode=500 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Environment variable 'SDC_CERT_DIR' was not provided. Could not load certificates. 2021-04-14T11:00:59.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4a103f8-1843-4145-b005-baa2a15bbd3d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:00:59.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4a103f8-1843-4145-b005-baa2a15bbd3d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22cf850a 2021-04-14T11:00:59.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4a103f8-1843-4145-b005-baa2a15bbd3d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:00:59.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4a103f8-1843-4145-b005-baa2a15bbd3d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:01.153Z [main] INFO o.o.s.b.c.d.e.EnvironmentsEngine RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE Environments engine is disabled 2021-04-14T11:01:01.275Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/topics (anonymous) ... 2021-04-14T11:01:01.423Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:01:01.441Z [pool-17-thread-1] WARN c.att.nsa.apiClient.http.HttpClient POST http://message-router.onap:3904/topics/create will send credentials over a clear channel. 2021-04-14T11:01:01.441Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient POST http://message-router.onap:3904/topics/create (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:01:02.749Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:01:02.999Z [pool-17-thread-1] INFO com.datastax.driver.core.utils.UUIDs PID obtained through native call to getpid(): 251 2021-04-14T11:01:03.050Z [pool-17-thread-1] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" STATUS = "CREATED" PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/producers/iPIxkpAMI8qTcQj8 will send credentials over a clear channel. 2021-04-14T11:01:03.050Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" STATUS = "CREATED" PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/producers/iPIxkpAMI8qTcQj8 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:01:03.151Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" STATUS = "CREATED" \t--> HTTP/1.1 200 OK 2021-04-14T11:01:03.158Z [pool-17-thread-1] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "iPIxkpAMI8qTcQj8" STATUS = "200" POST http://message-router.onap:3904/topics/create will send credentials over a clear channel. 2021-04-14T11:01:03.158Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "iPIxkpAMI8qTcQj8" STATUS = "200" POST http://message-router.onap:3904/topics/create (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:01:03.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e406a398-b63c-4c1f-a0f3-9e1baab5b621 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:03.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e406a398-b63c-4c1f-a0f3-9e1baab5b621 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e6fb77a 2021-04-14T11:01:03.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e406a398-b63c-4c1f-a0f3-9e1baab5b621 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:03.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e406a398-b63c-4c1f-a0f3-9e1baab5b621 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:04.077Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-NOTIF-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "iPIxkpAMI8qTcQj8" STATUS = "200" \t--> HTTP/1.1 200 OK 2021-04-14T11:01:04.114Z [pool-17-thread-1] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" STATUS = "CREATED" PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/consumers/iPIxkpAMI8qTcQj8 will send credentials over a clear channel. 2021-04-14T11:01:04.114Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" STATUS = "CREATED" PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/consumers/iPIxkpAMI8qTcQj8 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:01:04.275Z [pool-17-thread-1] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "CreateDistributionTopic" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" STATUS = "CREATED" \t--> HTTP/1.1 200 OK 2021-04-14T11:01:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:01:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:01:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:01:05.031Z [main] INFO o.o.s.b.c.s.AsdcComponentsCleanerTask RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Enter init method of AsdcComponentsCleaner 2021-04-14T11:01:05.032Z [main] INFO o.o.s.b.c.s.AsdcComponentsCleanerTask RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m End init method of AsdcComponentsCleaner 2021-04-14T11:01:05.095Z [main] INFO o.s.b.f.a.AutowiredAnnotationBeanPostProcessor RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Autowired annotation is not supported on static methods: public static void org.openecomp.sdc.be.components.impl.ImportUtils.setComponentsUtils(org.openecomp.sdc.be.impl.ComponentsUtils) 2021-04-14T11:01:06.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63b50f0-bc3a-40a6-af2e-42e2b2ffc79b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:06.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63b50f0-bc3a-40a6-af2e-42e2b2ffc79b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@104abb30 2021-04-14T11:01:06.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63b50f0-bc3a-40a6-af2e-42e2b2ffc79b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:06.335Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a63b50f0-bc3a-40a6-af2e-42e2b2ffc79b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:06.342Z [main] INFO o.o.s.b.d.cassandra.FeatureToggleDao RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ** FeatureToggleDao created 2021-04-14T11:01:06.805Z [main] INFO o.s.web.context.ContextLoader RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Root WebApplicationContext initialized in 31668 ms 2021-04-14T11:01:09.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3a3d0c7-7ca2-4215-9b6e-7e2e21d001c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:09.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3a3d0c7-7ca2-4215-9b6e-7e2e21d001c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2593b202 2021-04-14T11:01:09.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3a3d0c7-7ca2-4215-9b6e-7e2e21d001c3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:09.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3a3d0c7-7ca2-4215-9b6e-7e2e21d001c3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:09.585Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-04-14T11:01:09.601Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-04-14T11:01:09.632Z [main] INFO o.a.c.b.FluentPropertyBeanIntrospector RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2021-04-14T11:01:12.385Z [main] INFO o.h.validator.internal.util.Version RequestID=14da52b8-bedf-4108-9414-53efc6d50b31 PartnerName=SDC.BE ServerIPAddress=10.242.62.146 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m HV000001: Hibernate Validator 5.3.6.Final 2021-04-14T11:01:12.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e44c1c-0931-462f-9cfa-9d5b618c9e96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:12.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e44c1c-0931-462f-9cfa-9d5b618c9e96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70002d7 2021-04-14T11:01:12.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e44c1c-0931-462f-9cfa-9d5b618c9e96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:12.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e44c1c-0931-462f-9cfa-9d5b618c9e96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:15.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=968e3196-78ab-41b7-ae91-5f500914b7ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:15.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=968e3196-78ab-41b7-ae91-5f500914b7ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42d6aa3c 2021-04-14T11:01:15.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=968e3196-78ab-41b7-ae91-5f500914b7ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:15.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=968e3196-78ab-41b7-ae91-5f500914b7ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:01:17.683Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:01:17.685Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL ErrorCategory=INFO RequestID=null ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster. 2021-04-14T11:01:17.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23390983-f31b-44cf-82e7-e8d75d8dcf74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:17.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23390983-f31b-44cf-82e7-e8d75d8dcf74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aed03c6 2021-04-14T11:01:17.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23390983-f31b-44cf-82e7-e8d75d8dcf74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:17.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23390983-f31b-44cf-82e7-e8d75d8dcf74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecde5aa-7c27-4f6c-b542-e0b310fc63cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecde5aa-7c27-4f6c-b542-e0b310fc63cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f49bc29 2021-04-14T11:01:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecde5aa-7c27-4f6c-b542-e0b310fc63cf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecde5aa-7c27-4f6c-b542-e0b310fc63cf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:21.085Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5ecde5aa-7c27-4f6c-b542-e0b310fc63cf ErrorCategory=INFO ServiceName=BE Component DE state changed from UNKNOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UNKNOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:21.085Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5ecde5aa-7c27-4f6c-b542-e0b310fc63cf ErrorCategory=INFO ServiceName=BE Component DE state changed from UNKNOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:21.435Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:01:24.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd1d7b3-c191-4e3c-8a53-f9893dcf792d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:24.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd1d7b3-c191-4e3c-8a53-f9893dcf792d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@185803ad 2021-04-14T11:01:24.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd1d7b3-c191-4e3c-8a53-f9893dcf792d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:24.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd1d7b3-c191-4e3c-8a53-f9893dcf792d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:27.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:27.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f28ddd0 2021-04-14T11:01:27.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:27.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:30.447Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:01:30.451Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:01:30.453Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:30.453Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=da198329-5f8c-4c59-bfa3-146dc7e4dee2 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:01:31.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d049462-3e8f-4a08-807f-670589e139fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:31.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d049462-3e8f-4a08-807f-670589e139fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dfa68b7 2021-04-14T11:01:31.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d049462-3e8f-4a08-807f-670589e139fd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:31.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d049462-3e8f-4a08-807f-670589e139fd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:34.435Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5d049462-3e8f-4a08-807f-670589e139fd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:01:34.435Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5d049462-3e8f-4a08-807f-670589e139fd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:01:35.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=912e4b21-7364-4f6f-b9d4-47ea06977428 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:35.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=912e4b21-7364-4f6f-b9d4-47ea06977428 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c62edab 2021-04-14T11:01:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=912e4b21-7364-4f6f-b9d4-47ea06977428 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=912e4b21-7364-4f6f-b9d4-47ea06977428 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:38.098Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=912e4b21-7364-4f6f-b9d4-47ea06977428 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:01:38.099Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=912e4b21-7364-4f6f-b9d4-47ea06977428 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:01:38.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76ddf196-3c7c-4597-8200-21d0f0093693 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:38.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76ddf196-3c7c-4597-8200-21d0f0093693 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f802b93 2021-04-14T11:01:38.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76ddf196-3c7c-4597-8200-21d0f0093693 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:38.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76ddf196-3c7c-4597-8200-21d0f0093693 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:39.190Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information. 2021-04-14T11:01:41.293Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=76ddf196-3c7c-4597-8200-21d0f0093693 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:01:41.293Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=76ddf196-3c7c-4597-8200-21d0f0093693 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:01:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42e5bee0-1522-4565-9a96-d17708293995 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42e5bee0-1522-4565-9a96-d17708293995 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b0bf75b 2021-04-14T11:01:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42e5bee0-1522-4565-9a96-d17708293995 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42e5bee0-1522-4565-9a96-d17708293995 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:44.552Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=42e5bee0-1522-4565-9a96-d17708293995 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:01:44.553Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=42e5bee0-1522-4565-9a96-d17708293995 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:01:44.553Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=42e5bee0-1522-4565-9a96-d17708293995 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:44.553Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=42e5bee0-1522-4565-9a96-d17708293995 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:45.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fce99a8-cc29-4cdf-b63e-aec8e034a3d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:45.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fce99a8-cc29-4cdf-b63e-aec8e034a3d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b0e5d6c 2021-04-14T11:01:45.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fce99a8-cc29-4cdf-b63e-aec8e034a3d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:45.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fce99a8-cc29-4cdf-b63e-aec8e034a3d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:47.146Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3fce99a8-cc29-4cdf-b63e-aec8e034a3d4 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:47.146Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3fce99a8-cc29-4cdf-b63e-aec8e034a3d4 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:48.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62a5645-32ca-451f-8bd7-c7cf124b18f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:48.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62a5645-32ca-451f-8bd7-c7cf124b18f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25744482 2021-04-14T11:01:48.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62a5645-32ca-451f-8bd7-c7cf124b18f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:48.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62a5645-32ca-451f-8bd7-c7cf124b18f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:49.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c0d26bc-a43c-48b4-8bc6-69b77ae37180 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:49.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c0d26bc-a43c-48b4-8bc6-69b77ae37180 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@215bedcd 2021-04-14T11:01:49.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c0d26bc-a43c-48b4-8bc6-69b77ae37180 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:49.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c0d26bc-a43c-48b4-8bc6-69b77ae37180 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ed9db7-13c9-45a0-aa05-4cbe07d8633f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ed9db7-13c9-45a0-aa05-4cbe07d8633f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@382721b7 2021-04-14T11:01:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ed9db7-13c9-45a0-aa05-4cbe07d8633f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ed9db7-13c9-45a0-aa05-4cbe07d8633f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:54.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:54.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@278f89e3 2021-04-14T11:01:54.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:54.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:01:57.145Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:01:57.147Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:01:57.149Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:57.149Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6a9fbf48-a75a-4b8e-ba9f-9642cd59309d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:01:57.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78dfe672-6f94-4abb-a639-3e655afbd582 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:01:57.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78dfe672-6f94-4abb-a639-3e655afbd582 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f38956b 2021-04-14T11:01:57.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78dfe672-6f94-4abb-a639-3e655afbd582 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:01:57.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78dfe672-6f94-4abb-a639-3e655afbd582 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:00.902Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=78dfe672-6f94-4abb-a639-3e655afbd582 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:00.904Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=78dfe672-6f94-4abb-a639-3e655afbd582 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:01.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3dc8f1-6831-49f2-85fb-399cd0cdb76f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:01.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3dc8f1-6831-49f2-85fb-399cd0cdb76f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6051f007 2021-04-14T11:02:01.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3dc8f1-6831-49f2-85fb-399cd0cdb76f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:01.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd3dc8f1-6831-49f2-85fb-399cd0cdb76f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:04.144Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fd3dc8f1-6831-49f2-85fb-399cd0cdb76f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:04.145Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fd3dc8f1-6831-49f2-85fb-399cd0cdb76f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:02:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:02:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:02:04.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1c8307-8f3e-467c-bd53-4d29e2658348 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:04.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1c8307-8f3e-467c-bd53-4d29e2658348 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ce1dcc4 2021-04-14T11:02:04.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1c8307-8f3e-467c-bd53-4d29e2658348 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:04.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1c8307-8f3e-467c-bd53-4d29e2658348 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:07.949Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0d1c8307-8f3e-467c-bd53-4d29e2658348 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:07.950Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0d1c8307-8f3e-467c-bd53-4d29e2658348 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:08.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0b03d5-00bf-4727-ad43-3ab5333af77c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:08.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0b03d5-00bf-4727-ad43-3ab5333af77c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4919b592 2021-04-14T11:02:08.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0b03d5-00bf-4727-ad43-3ab5333af77c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:08.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a0b03d5-00bf-4727-ad43-3ab5333af77c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:11.641Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7a0b03d5-00bf-4727-ad43-3ab5333af77c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:11.641Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7a0b03d5-00bf-4727-ad43-3ab5333af77c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:12.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2e88f4-b07d-49c8-888f-20b077c827ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:12.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2e88f4-b07d-49c8-888f-20b077c827ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@109a602d 2021-04-14T11:02:12.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2e88f4-b07d-49c8-888f-20b077c827ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:12.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d2e88f4-b07d-49c8-888f-20b077c827ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:13.894Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond 2021-04-14T11:02:13.894Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:02:15.443Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4d2e88f4-b07d-49c8-888f-20b077c827ce ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:15.444Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4d2e88f4-b07d-49c8-888f-20b077c827ce ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:16.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0693369b-f2e4-49ed-8612-5de31c78bc9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:16.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0693369b-f2e4-49ed-8612-5de31c78bc9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fd3701c 2021-04-14T11:02:16.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0693369b-f2e4-49ed-8612-5de31c78bc9b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:16.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0693369b-f2e4-49ed-8612-5de31c78bc9b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:17.249Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:02:17.249Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:02:17.254Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:02:17.254Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:02:17.256Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:02:17.256Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:02:17.534Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:02:17.538Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR ErrorCategory=ERROR RequestID=null ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:02:17.549Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:02:19.104Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0693369b-f2e4-49ed-8612-5de31c78bc9b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:19.104Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0693369b-f2e4-49ed-8612-5de31c78bc9b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:19.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eb69514-9cd7-479f-bf32-7902a5d79b54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:19.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eb69514-9cd7-479f-bf32-7902a5d79b54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1200a237 2021-04-14T11:02:19.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eb69514-9cd7-479f-bf32-7902a5d79b54 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:19.263Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9eb69514-9cd7-479f-bf32-7902a5d79b54 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:22.277Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9eb69514-9cd7-479f-bf32-7902a5d79b54 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:22.278Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9eb69514-9cd7-479f-bf32-7902a5d79b54 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:22.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef58dca0-bd75-474e-a2e7-bbbf256af470 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:22.633Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef58dca0-bd75-474e-a2e7-bbbf256af470 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ab7d7ab 2021-04-14T11:02:22.633Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef58dca0-bd75-474e-a2e7-bbbf256af470 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:22.633Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef58dca0-bd75-474e-a2e7-bbbf256af470 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:23.037Z [qtp580718781-15] INFO com.jcabi.aspects.aj.NamedThreads RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/healthCheck EntryTimestamp=2021-04-14T11:02:22.933Z InvocationID=1046fe05-c6c0-45c5-9dfd-82f917c3d79d PartnerName=kube-probe/1.18 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m jcabi-aspects 0.20.1/f0aff93 started new daemon thread jcabi-loggable for watching of @Loggable annotated methods 2021-04-14T11:02:25.662Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ef58dca0-bd75-474e-a2e7-bbbf256af470 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:25.662Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ef58dca0-bd75-474e-a2e7-bbbf256af470 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:26.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=400c011b-5a93-4801-8d90-5362309360ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:26.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=400c011b-5a93-4801-8d90-5362309360ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d20bcce 2021-04-14T11:02:26.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=400c011b-5a93-4801-8d90-5362309360ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:26.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=400c011b-5a93-4801-8d90-5362309360ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:29.449Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=400c011b-5a93-4801-8d90-5362309360ae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:29.449Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=400c011b-5a93-4801-8d90-5362309360ae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:30.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd0a2789-148b-4652-8e3e-c382c4f9aa9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:30.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd0a2789-148b-4652-8e3e-c382c4f9aa9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@375faa14 2021-04-14T11:02:30.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd0a2789-148b-4652-8e3e-c382c4f9aa9d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:30.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd0a2789-148b-4652-8e3e-c382c4f9aa9d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:33.135Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bd0a2789-148b-4652-8e3e-c382c4f9aa9d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:33.136Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bd0a2789-148b-4652-8e3e-c382c4f9aa9d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:33.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37fadd7-bfbf-458c-8168-16f0c91fa88c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:33.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37fadd7-bfbf-458c-8168-16f0c91fa88c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10ad3ada 2021-04-14T11:02:33.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37fadd7-bfbf-458c-8168-16f0c91fa88c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:33.298Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37fadd7-bfbf-458c-8168-16f0c91fa88c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:34.216Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 500 Server Error 2021-04-14T11:02:34.222Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:36.313Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c37fadd7-bfbf-458c-8168-16f0c91fa88c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:36.313Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c37fadd7-bfbf-458c-8168-16f0c91fa88c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:36.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9e97c0-8204-4702-90ae-2c953e31fdde PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:36.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9e97c0-8204-4702-90ae-2c953e31fdde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40e9ea97 2021-04-14T11:02:36.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9e97c0-8204-4702-90ae-2c953e31fdde PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:36.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e9e97c0-8204-4702-90ae-2c953e31fdde PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:39.822Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4e9e97c0-8204-4702-90ae-2c953e31fdde ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:39.822Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4e9e97c0-8204-4702-90ae-2c953e31fdde ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:39.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b42017-e754-4d3d-a517-1055e06a9e52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:39.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b42017-e754-4d3d-a517-1055e06a9e52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2887155d 2021-04-14T11:02:39.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b42017-e754-4d3d-a517-1055e06a9e52 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:39.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b42017-e754-4d3d-a517-1055e06a9e52 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:40.547Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:40.550Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:44.892Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:44.894Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:45.745Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a8b42017-e754-4d3d-a517-1055e06a9e52 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:02:45.745Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a8b42017-e754-4d3d-a517-1055e06a9e52 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:02:46.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cff7d086-be3d-4498-9fe8-4cd3ea845ea5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:46.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cff7d086-be3d-4498-9fe8-4cd3ea845ea5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a8223fc 2021-04-14T11:02:46.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cff7d086-be3d-4498-9fe8-4cd3ea845ea5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:46.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cff7d086-be3d-4498-9fe8-4cd3ea845ea5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:47.941Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:47.942Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:49.349Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:49.351Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:49.502Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cff7d086-be3d-4498-9fe8-4cd3ea845ea5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:49.503Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cff7d086-be3d-4498-9fe8-4cd3ea845ea5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:50.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d13629aa-ca25-4812-b3dc-9b4981ae9e03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:50.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d13629aa-ca25-4812-b3dc-9b4981ae9e03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27b5ed46 2021-04-14T11:02:50.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d13629aa-ca25-4812-b3dc-9b4981ae9e03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:50.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d13629aa-ca25-4812-b3dc-9b4981ae9e03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:50.835Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:50.837Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:52.263Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:52.264Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:52.343Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:52.344Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:52.823Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:52.825Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:52.859Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:52.862Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:53.048Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d13629aa-ca25-4812-b3dc-9b4981ae9e03 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:53.049Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d13629aa-ca25-4812-b3dc-9b4981ae9e03 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:53.296Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:53.298Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:02:53.403Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:02:53.404Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster. 2021-04-14T11:02:53.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39956e83-6519-42d5-a03a-f0afa126f9dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:53.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39956e83-6519-42d5-a03a-f0afa126f9dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fa483a0 2021-04-14T11:02:53.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39956e83-6519-42d5-a03a-f0afa126f9dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:53.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39956e83-6519-42d5-a03a-f0afa126f9dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:02:56.851Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=39956e83-6519-42d5-a03a-f0afa126f9dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:02:56.851Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=39956e83-6519-42d5-a03a-f0afa126f9dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:02:57.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e639b2b-496d-4bbe-b799-07f121492dff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:02:57.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e639b2b-496d-4bbe-b799-07f121492dff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4155dc7b 2021-04-14T11:02:57.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e639b2b-496d-4bbe-b799-07f121492dff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:02:57.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e639b2b-496d-4bbe-b799-07f121492dff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:00.599Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3e639b2b-496d-4bbe-b799-07f121492dff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:03:00.600Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3e639b2b-496d-4bbe-b799-07f121492dff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:03:00.601Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3e639b2b-496d-4bbe-b799-07f121492dff ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:00.601Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3e639b2b-496d-4bbe-b799-07f121492dff ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:00.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcf0551-6a93-495b-a3e4-42000355eb75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:00.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcf0551-6a93-495b-a3e4-42000355eb75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@286f4b51 2021-04-14T11:03:00.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcf0551-6a93-495b-a3e4-42000355eb75 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:00.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dcf0551-6a93-495b-a3e4-42000355eb75 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:01.161Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9e7865dc-19a4-4666-a64c-2ca450a3e98d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=2 Severity=0 PartnerName=aai auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.130 StatusCode=INPROGRESS RemoteHost=10.242.62.130 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:01.154599Z InvocationID=72a8a876-3220-4eef-8c37-34c62c77297a LogTimestamp=2021-04-14T11:03:01.156721Z Entering 2021-04-14T11:03:01.162Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9e7865dc-19a4-4666-a64c-2ca450a3e98d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=2 Severity=0 PartnerName=aai auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.130 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.130 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:01.154599Z InvocationID=72a8a876-3220-4eef-8c37-34c62c77297a LogTimestamp=2021-04-14T11:03:01.156721Z localAddr=10.242.62.146 remoteAddr=10.242.62.130 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:03:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:03:01.257Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=95 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:03:01.162Z InvocationID=bb44ffed-7439-4ba0-afec-76c3b6766bdd LogTimestamp=2021-04-14T11:03:01.257501Z ResponseDesc=OK Exiting. 2021-04-14T11:03:01.259Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:03:02.256Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3dcf0551-6a93-495b-a3e4-42000355eb75 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:02.257Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3dcf0551-6a93-495b-a3e4-42000355eb75 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:02.658Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:03:03.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3885d6eb-de49-4657-9624-9da27a7bbfbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:03.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3885d6eb-de49-4657-9624-9da27a7bbfbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18d51955 2021-04-14T11:03:03.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3885d6eb-de49-4657-9624-9da27a7bbfbb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:03.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3885d6eb-de49-4657-9624-9da27a7bbfbb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:04.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d1481-43bb-4f5e-95d3-f70161bbcf22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:04.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d1481-43bb-4f5e-95d3-f70161bbcf22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40f8d07b 2021-04-14T11:03:04.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d1481-43bb-4f5e-95d3-f70161bbcf22 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:04.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d1481-43bb-4f5e-95d3-f70161bbcf22 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:03:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:03:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:03:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:03:05.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b2a1665-c084-4a57-8aeb-0ec2de643f35 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:05.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b2a1665-c084-4a57-8aeb-0ec2de643f35 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@121f3ef6 2021-04-14T11:03:05.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b2a1665-c084-4a57-8aeb-0ec2de643f35 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:05.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b2a1665-c084-4a57-8aeb-0ec2de643f35 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:06.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05e09cdb-e2c1-4a76-80d1-f3c7ad831823 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:06.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05e09cdb-e2c1-4a76-80d1-f3c7ad831823 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fe383 2021-04-14T11:03:06.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05e09cdb-e2c1-4a76-80d1-f3c7ad831823 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:06.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05e09cdb-e2c1-4a76-80d1-f3c7ad831823 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:08.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=247edf25-9b92-405c-a755-cf631fc0fb14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:08.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=247edf25-9b92-405c-a755-cf631fc0fb14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30804d62 2021-04-14T11:03:08.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=247edf25-9b92-405c-a755-cf631fc0fb14 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:08.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=247edf25-9b92-405c-a755-cf631fc0fb14 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:09.043Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=828d3370-0041-4d5a-9f12-da5ad92cf17e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=aai ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.130 StatusCode=INPROGRESS RemoteHost=10.242.62.130 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:09.042595Z InvocationID=34a88675-48b7-47c4-ad56-d76100de14b5 LogTimestamp=2021-04-14T11:03:09.042728Z Entering 2021-04-14T11:03:09.043Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=828d3370-0041-4d5a-9f12-da5ad92cf17e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=aai ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.130 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.130 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:09.042595Z InvocationID=34a88675-48b7-47c4-ad56-d76100de14b5 LogTimestamp=2021-04-14T11:03:09.042728Z localAddr=10.242.62.146 remoteAddr=10.242.62.130 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:03:09.069Z [qtp580718781-13] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/Sfy75oYnFDsT8zTI will send credentials over a clear channel. 2021-04-14T11:03:09.069Z [qtp580718781-13] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/Sfy75oYnFDsT8zTI (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:03:09.128Z [qtp580718781-13] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:03:09.187Z [qtp580718781-13] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "Sfy75oYnFDsT8zTI" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/Sfy75oYnFDsT8zTI will send credentials over a clear channel. 2021-04-14T11:03:09.187Z [qtp580718781-13] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "Sfy75oYnFDsT8zTI" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/Sfy75oYnFDsT8zTI (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:03:09.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4628aff3-8161-45f9-96a6-898da129d760 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:09.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4628aff3-8161-45f9-96a6-898da129d760 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36fd2801 2021-04-14T11:03:09.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4628aff3-8161-45f9-96a6-898da129d760 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:09.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4628aff3-8161-45f9-96a6-898da129d760 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:09.870Z [qtp580718781-13] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "Sfy75oYnFDsT8zTI" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:03:09.937Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "aai-ml" API_KEY = "Sfy75oYnFDsT8zTI" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=893 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:09.043Z InvocationID=ede19b2f-83dd-4e77-b59b-61f90762624f LogTimestamp=2021-04-14T11:03:09.936936Z ResponseDesc=OK Exiting. 2021-04-14T11:03:09.938Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:03:11.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a1e68e-9dae-4f14-9df9-0a8f0b3b4bea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:11.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a1e68e-9dae-4f14-9df9-0a8f0b3b4bea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dfe58a6 2021-04-14T11:03:11.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a1e68e-9dae-4f14-9df9-0a8f0b3b4bea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:11.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92a1e68e-9dae-4f14-9df9-0a8f0b3b4bea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:13.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ab3962e-2e6c-4988-a148-924dc70aaa2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:13.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ab3962e-2e6c-4988-a148-924dc70aaa2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22b29b61 2021-04-14T11:03:13.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ab3962e-2e6c-4988-a148-924dc70aaa2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:13.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ab3962e-2e6c-4988-a148-924dc70aaa2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:15.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6496a26c-9488-424c-bedc-edaf323fc3f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:15.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6496a26c-9488-424c-bedc-edaf323fc3f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10eb2908 2021-04-14T11:03:15.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6496a26c-9488-424c-bedc-edaf323fc3f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:15.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6496a26c-9488-424c-bedc-edaf323fc3f8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:15.341Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=deaf3616-f5c4-430d-8c5f-ca8c9586711a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/user/jh0003 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:15.340583Z InvocationID=fd298541-b07a-4c14-9416-35690f62ab5b LogTimestamp=2021-04-14T11:03:15.340947Z Entering 2021-04-14T11:03:15.342Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=deaf3616-f5c4-430d-8c5f-ca8c9586711a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/user/jh0003 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:15.340583Z InvocationID=fd298541-b07a-4c14-9416-35690f62ab5b LogTimestamp=2021-04-14T11:03:15.340947Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 GET /sdc2/rest/v1/user/jh0003 HTTP/1.1 2021-04-14T11:03:15.412Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=68 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/user/jh0003 EntryTimestamp=2021-04-14T11:03:15.343Z InvocationID=053e4824-5490-40a3-a750-ea01a5b058f9 LogTimestamp=2021-04-14T11:03:15.411816Z ResponseDesc=OK Exiting. 2021-04-14T11:03:15.413Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/user/jh0003 HTTP/1.1 SC="200" 2021-04-14T11:03:15.531Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:15.531695Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:15.532Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:15.531695Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:15.533Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userdemo HTTP/1.1 SC="500" 2021-04-14T11:03:15.613Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=eb9eb9cc-530a-4c10-b66e-93f865592ab7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:15.613322Z InvocationID=e2230a61-d24d-4993-9cb1-64351f0fddc8 LogTimestamp=2021-04-14T11:03:15.613445Z Entering 2021-04-14T11:03:15.614Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=eb9eb9cc-530a-4c10-b66e-93f865592ab7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:15.613322Z InvocationID=e2230a61-d24d-4993-9cb1-64351f0fddc8 LogTimestamp=2021-04-14T11:03:15.613445Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/user HTTP/1.1 2021-04-14T11:03:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:03:16.571Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:03:17.598Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "demo demo demo demo@openecomp.org ADMIN" STATUS = "201" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/user EntryTimestamp=2021-04-14T11:03:15.614Z InvocationID=ab8c11bd-7fd1-4d05-8ca3-b84c96db177e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:03:17.599Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "demo demo demo demo@openecomp.org ADMIN" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user TargetServiceName=null EntryTimestamp=2021-04-14T11:03:15.614Z InvocationID=ab8c11bd-7fd1-4d05-8ca3-b84c96db177e ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:03:17.604Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "demo demo demo demo@openecomp.org ADMIN" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1989 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user TargetServiceName=null EntryTimestamp=2021-04-14T11:03:15.614Z InvocationID=ab8c11bd-7fd1-4d05-8ca3-b84c96db177e ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.603794Z ResponseDesc=Created Exiting. 2021-04-14T11:03:17.605Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/user HTTP/1.1 SC="201" 2021-04-14T11:03:17.636Z [qtp580718781-18] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.636393Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:17.636Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.636393Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:17.638Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userop0001 HTTP/1.1 SC="500" 2021-04-14T11:03:17.652Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=98ea58af-e76f-4ef6-bc6f-0733cf43256f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.652327Z InvocationID=304956de-b26f-440c-9a16-a6a76a9415f6 LogTimestamp=2021-04-14T11:03:17.652412Z Entering 2021-04-14T11:03:17.652Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=98ea58af-e76f-4ef6-bc6f-0733cf43256f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.652327Z InvocationID=304956de-b26f-440c-9a16-a6a76a9415f6 LogTimestamp=2021-04-14T11:03:17.652412Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/user HTTP/1.1 2021-04-14T11:03:17.725Z [qtp580718781-16] ERROR o.o.sdc.be.servlets.UserAdminServlet RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/user EntryTimestamp=2021-04-14T11:03:17.653Z InvocationID=f980f5e3-1d80-48a7-b9d0-ea821981c8f0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m #createUser('Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/user)@6fa76799', 'User [firstName=Oper, lastName=P, userId=op0001, email=op0001@openecomp.org, role=OPS, last login time=null]', 'jh0003'): thrown org.openecomp.sdc.be.components.impl.exceptions.ByActionStatusComponentException out of org.openecomp.sdc.be.user.UserBusinessLogic#validateRole[165] in 62ms 2021-04-14T11:03:17.729Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=400 RequestID=null ElapsedTime=75 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user ErrorDesc=Bad Request EntryTimestamp=2021-04-14T11:03:17.653Z InvocationID=f980f5e3-1d80-48a7-b9d0-ea821981c8f0 ErrorCode=400 LogTimestamp=2021-04-14T11:03:17.728688Z ResponseDesc=Bad Request Exiting. 2021-04-14T11:03:17.730Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/user HTTP/1.1 SC="400" 2021-04-14T11:03:17.751Z [qtp580718781-15] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.751032Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:17.751Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.751032Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:17.752Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usergv0001 HTTP/1.1 SC="500" 2021-04-14T11:03:17.765Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ef75832c-9ee0-48e9-873f-92b47c416f4c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.764559Z InvocationID=c02b3da8-c1c9-4b87-a25a-45ff3ad30490 LogTimestamp=2021-04-14T11:03:17.764702Z Entering 2021-04-14T11:03:17.765Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ef75832c-9ee0-48e9-873f-92b47c416f4c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.764559Z InvocationID=c02b3da8-c1c9-4b87-a25a-45ff3ad30490 LogTimestamp=2021-04-14T11:03:17.764702Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/user HTTP/1.1 2021-04-14T11:03:17.814Z [qtp580718781-13] ERROR o.o.sdc.be.servlets.UserAdminServlet RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/user EntryTimestamp=2021-04-14T11:03:17.765Z InvocationID=b90062be-9547-4e41-9b16-2e5bd70f8c4f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m #createUser('Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/user)@6fa76799', 'User [firstName=Giuseppe, lastName=Verdi, userId=gv0001, email=gv0001@openecomp.org, role=GOVERNOR, last login time=null]', 'jh0003'): thrown org.openecomp.sdc.be.components.impl.exceptions.ByActionStatusComponentException out of org.openecomp.sdc.be.user.UserBusinessLogic#validateRole[165] in 47ms 2021-04-14T11:03:17.815Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=400 RequestID=null ElapsedTime=49 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user ErrorDesc=Bad Request EntryTimestamp=2021-04-14T11:03:17.765Z InvocationID=b90062be-9547-4e41-9b16-2e5bd70f8c4f ErrorCode=400 LogTimestamp=2021-04-14T11:03:17.814835Z ResponseDesc=Bad Request Exiting. 2021-04-14T11:03:17.816Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/user HTTP/1.1 SC="400" 2021-04-14T11:03:17.830Z [qtp580718781-11] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.830643Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:17.830Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.830643Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:17.832Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userjh0003 HTTP/1.1 SC="500" 2021-04-14T11:03:17.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01c98f2c-0c62-4315-819d-2e340b5e16f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:17.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01c98f2c-0c62-4315-819d-2e340b5e16f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f09a634 2021-04-14T11:03:17.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01c98f2c-0c62-4315-819d-2e340b5e16f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:17.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01c98f2c-0c62-4315-819d-2e340b5e16f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:17.893Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c2b842e8-a43f-4503-b863-6ab55c353a1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.893454Z InvocationID=9d3653e6-d6d0-49f5-bc4d-6fe4161ffdbe LogTimestamp=2021-04-14T11:03:17.893577Z Entering 2021-04-14T11:03:17.894Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c2b842e8-a43f-4503-b863-6ab55c353a1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.893454Z InvocationID=9d3653e6-d6d0-49f5-bc4d-6fe4161ffdbe LogTimestamp=2021-04-14T11:03:17.893577Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/user HTTP/1.1 2021-04-14T11:03:17.922Z [qtp580718781-12] ERROR o.o.sdc.be.servlets.UserAdminServlet AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "" STATUS = "409" DESC = "SVC4570: Error: An administrator is not allowed to change his/her role." RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/user EntryTimestamp=2021-04-14T11:03:17.894Z InvocationID=2fa95c83-8b08-4b77-a9ef-27b217842bbd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m #createUser('Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/user)@6fa76799', 'User [firstName=Jimmy, lastName=Hendrix, userId=jh0003, email=jh0003@openecomp.org, role=Admin, last login time=null]', 'jh0003'): thrown org.openecomp.sdc.be.components.impl.exceptions.ByResponseFormatComponentException out of org.openecomp.sdc.be.impl.ComponentsUtils#auditAdminUserActionAndThrowException[1271] in 27ms 2021-04-14T11:03:17.934Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "" STATUS = "409" DESC = "SVC4570: Error: An administrator is not allowed to change his/her role." ResponseCode=409 RequestID=null ElapsedTime=37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user ErrorDesc=Conflict EntryTimestamp=2021-04-14T11:03:17.894Z InvocationID=2fa95c83-8b08-4b77-a9ef-27b217842bbd ErrorCode=409 LogTimestamp=2021-04-14T11:03:17.931106Z ResponseDesc=Conflict Exiting. 2021-04-14T11:03:17.936Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/user HTTP/1.1 SC="409" 2021-04-14T11:03:17.952Z [qtp580718781-19] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.952571Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:17.952Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:17.952571Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:17.953Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userjm0007 HTTP/1.1 SC="500" 2021-04-14T11:03:17.994Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=516ae3d3-2eec-4d02-998d-2160959e5610 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.993969Z InvocationID=f89cbc93-8b27-4214-9307-eae743990af6 LogTimestamp=2021-04-14T11:03:17.994064Z Entering 2021-04-14T11:03:17.995Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=516ae3d3-2eec-4d02-998d-2160959e5610 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:17.993969Z InvocationID=f89cbc93-8b27-4214-9307-eae743990af6 LogTimestamp=2021-04-14T11:03:17.994064Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/user HTTP/1.1 2021-04-14T11:03:19.288Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "jm0007 Joni Mitchell jm0007@openecomp.org TESTER" STATUS = "201" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/user EntryTimestamp=2021-04-14T11:03:17.995Z InvocationID=24b530ca-75fb-4207-adeb-48103cad4927 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:03:19.289Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "jm0007 Joni Mitchell jm0007@openecomp.org TESTER" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user TargetServiceName=null EntryTimestamp=2021-04-14T11:03:17.995Z InvocationID=24b530ca-75fb-4207-adeb-48103cad4927 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:03:19.290Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "jm0007 Joni Mitchell jm0007@openecomp.org TESTER" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1295 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user TargetServiceName=null EntryTimestamp=2021-04-14T11:03:17.995Z InvocationID=24b530ca-75fb-4207-adeb-48103cad4927 ErrorCode=500 LogTimestamp=2021-04-14T11:03:19.290393Z ResponseDesc=Created Exiting. 2021-04-14T11:03:19.291Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/user HTTP/1.1 SC="201" 2021-04-14T11:03:19.387Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:19.387392Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:19.387Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:19.387392Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:19.388Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usercs0008 HTTP/1.1 SC="500" 2021-04-14T11:03:19.404Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=607a68b2-d147-4c61-8f2f-e928ab89999d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:19.404034Z InvocationID=8daa709e-e993-45e8-9055-6d64d288f784 LogTimestamp=2021-04-14T11:03:19.404191Z Entering 2021-04-14T11:03:19.404Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=607a68b2-d147-4c61-8f2f-e928ab89999d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:19.404034Z InvocationID=8daa709e-e993-45e8-9055-6d64d288f784 LogTimestamp=2021-04-14T11:03:19.404191Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/user HTTP/1.1 2021-04-14T11:03:20.025Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "cs0008 Carlos Santana cs0008r@openecomp.org DESIGNER" STATUS = "201" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/user EntryTimestamp=2021-04-14T11:03:19.404Z InvocationID=cff0d123-9e15-4ef6-baf6-c5ff5a9a9d1c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:03:20.025Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "cs0008 Carlos Santana cs0008r@openecomp.org DESIGNER" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user TargetServiceName=null EntryTimestamp=2021-04-14T11:03:19.404Z InvocationID=cff0d123-9e15-4ef6-baf6-c5ff5a9a9d1c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:03:20.026Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddUser" MODIFIER = "Jimmy Hendrix(jh0003)" USER_BEFORE = "" USER_AFTER = "cs0008 Carlos Santana cs0008r@openecomp.org DESIGNER" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=622 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/user TargetServiceName=null EntryTimestamp=2021-04-14T11:03:19.404Z InvocationID=cff0d123-9e15-4ef6-baf6-c5ff5a9a9d1c ErrorCode=500 LogTimestamp=2021-04-14T11:03:20.026281Z ResponseDesc=Created Exiting. 2021-04-14T11:03:20.027Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/user HTTP/1.1 SC="201" 2021-04-14T11:03:20.399Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=400eddec-a1df-4d67-81ab-1adcb8f91618 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user/jh0003 ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:20.399399Z InvocationID=064eac5c-b748-4d4a-ab62-4f95f302580e LogTimestamp=2021-04-14T11:03:20.399491Z Entering 2021-04-14T11:03:20.399Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=400eddec-a1df-4d67-81ab-1adcb8f91618 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user/jh0003 ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:20.399399Z InvocationID=064eac5c-b748-4d4a-ab62-4f95f302580e LogTimestamp=2021-04-14T11:03:20.399491Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 GET /sdc2/rest/v1/user/jh0003 HTTP/1.1 2021-04-14T11:03:20.410Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/user/jh0003 EntryTimestamp=2021-04-14T11:03:20.400Z InvocationID=705daa88-794a-4605-921e-e5886b1adb49 LogTimestamp=2021-04-14T11:03:20.409706Z ResponseDesc=OK Exiting. 2021-04-14T11:03:20.410Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/user/jh0003 HTTP/1.1 SC="200" 2021-04-14T11:03:20.425Z [qtp580718781-14] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:20.425375Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:20.425Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:20.425375Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:20.426Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/useraai HTTP/1.1 SC="500" 2021-04-14T11:03:20.449Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0e5d61af-a5bd-4551-9832-ce5dd8c092e0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/consumers ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:20.448560Z InvocationID=c0cf5c42-e7c7-4c72-ac76-66f7b43fd397 LogTimestamp=2021-04-14T11:03:20.448675Z Entering 2021-04-14T11:03:20.449Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0e5d61af-a5bd-4551-9832-ce5dd8c092e0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/consumers ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:20.448560Z InvocationID=c0cf5c42-e7c7-4c72-ac76-66f7b43fd397 LogTimestamp=2021-04-14T11:03:20.448675Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:20.501Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:20.450Z InvocationID=32ac93f8-8daf-4621-859e-3d59566274a1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id aai 2021-04-14T11:03:20.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29227b-c540-42f8-9911-d36b308e26a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:20.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29227b-c540-42f8-9911-d36b308e26a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@609dec1b 2021-04-14T11:03:20.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29227b-c540-42f8-9911-d36b308e26a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:20.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29227b-c540-42f8-9911-d36b308e26a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:21.811Z [qtp580718781-17] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:20.450Z InvocationID=32ac93f8-8daf-4621-859e-3d59566274a1 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node aai. status returned is NOT_FOUND 2021-04-14T11:03:22.418Z [qtp580718781-17] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "aai,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:20.450Z InvocationID=32ac93f8-8daf-4621-859e-3d59566274a1 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:22.996Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=55a5789d-b177-4307-94bc-d3bf5d39b257 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=mso ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.205 StatusCode=INPROGRESS RemoteHost=10.242.135.205 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:22.995599Z InvocationID=59aaf35b-5186-4a8f-9349-8709b7b649cb LogTimestamp=2021-04-14T11:03:22.995681Z Entering 2021-04-14T11:03:22.996Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=55a5789d-b177-4307-94bc-d3bf5d39b257 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=mso ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.205 StatusCode=INPROGRESS userId=null RemoteHost=10.242.135.205 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:22.995599Z InvocationID=59aaf35b-5186-4a8f-9349-8709b7b649cb LogTimestamp=2021-04-14T11:03:22.995681Z localAddr=10.242.62.146 remoteAddr=10.242.135.205 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:03:22.998Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:03:22.996Z InvocationID=597426f4-f898-4181-b956-a98f572dbfa2 LogTimestamp=2021-04-14T11:03:22.998100Z ResponseDesc=OK Exiting. 2021-04-14T11:03:22.998Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:03:23.026Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "aai,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2575 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:20.450Z InvocationID=32ac93f8-8daf-4621-859e-3d59566274a1 ErrorCode=500 LogTimestamp=2021-04-14T11:03:23.025884Z ResponseDesc=Created Exiting. 2021-04-14T11:03:23.026Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:23.042Z [qtp580718781-12] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:23.042183Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:23.042Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:23.042183Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:23.042Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userappc HTTP/1.1 SC="500" 2021-04-14T11:03:23.117Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=18e805ea-7930-48f4-b3c7-4eb6a86bda6a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:23.116807Z InvocationID=5c2d483b-7174-429d-a17a-dd92ba9a2e75 LogTimestamp=2021-04-14T11:03:23.116903Z Entering 2021-04-14T11:03:23.117Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=18e805ea-7930-48f4-b3c7-4eb6a86bda6a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:23.116807Z InvocationID=5c2d483b-7174-429d-a17a-dd92ba9a2e75 LogTimestamp=2021-04-14T11:03:23.116903Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:23.127Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:23.117Z InvocationID=8fe8bd1e-cbc8-429f-a86b-aa6559876386 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id appc 2021-04-14T11:03:23.496Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK 2021-04-14T11:03:23.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10a5ae97-2d45-49af-8bbe-c704ab934f1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:23.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10a5ae97-2d45-49af-8bbe-c704ab934f1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56421afa 2021-04-14T11:03:23.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10a5ae97-2d45-49af-8bbe-c704ab934f1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:23.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10a5ae97-2d45-49af-8bbe-c704ab934f1d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:24.445Z [qtp580718781-19] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:23.117Z InvocationID=8fe8bd1e-cbc8-429f-a86b-aa6559876386 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node appc. status returned is NOT_FOUND 2021-04-14T11:03:24.542Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0be5d0d7-82e1-4b8c-824b-6ff9421c132e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=mso ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.205 StatusCode=INPROGRESS RemoteHost=10.242.135.205 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:24.541994Z InvocationID=6a9d5e5f-7c3b-4ea6-8bbb-214584edd2b8 LogTimestamp=2021-04-14T11:03:24.542094Z Entering 2021-04-14T11:03:24.542Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0be5d0d7-82e1-4b8c-824b-6ff9421c132e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=mso ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.205 StatusCode=INPROGRESS userId=null RemoteHost=10.242.135.205 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:24.541994Z InvocationID=6a9d5e5f-7c3b-4ea6-8bbb-214584edd2b8 LogTimestamp=2021-04-14T11:03:24.542094Z localAddr=10.242.62.146 remoteAddr=10.242.135.205 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:03:24.548Z [qtp580718781-14] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/HRxK0JXb86fWgJkb will send credentials over a clear channel. 2021-04-14T11:03:24.548Z [qtp580718781-14] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/HRxK0JXb86fWgJkb (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:03:24.883Z [qtp580718781-14] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:03:24.933Z [qtp580718781-14] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "HRxK0JXb86fWgJkb" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/consumers/HRxK0JXb86fWgJkb will send credentials over a clear channel. 2021-04-14T11:03:24.933Z [qtp580718781-14] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "HRxK0JXb86fWgJkb" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/consumers/HRxK0JXb86fWgJkb (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:03:25.036Z [qtp580718781-19] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "appc,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:23.117Z InvocationID=8fe8bd1e-cbc8-429f-a86b-aa6559876386 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:26.383Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "appc,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=3266 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:23.117Z InvocationID=8fe8bd1e-cbc8-429f-a86b-aa6559876386 ErrorCode=500 LogTimestamp=2021-04-14T11:03:26.383282Z ResponseDesc=Created Exiting. 2021-04-14T11:03:26.384Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:26.515Z [qtp580718781-14] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "HRxK0JXb86fWgJkb" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:03:26.520Z [qtp580718781-14] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "CONSUMER" API_KEY = "HRxK0JXb86fWgJkb" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/HRxK0JXb86fWgJkb will send credentials over a clear channel. 2021-04-14T11:03:26.520Z [qtp580718781-14] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "CONSUMER" API_KEY = "HRxK0JXb86fWgJkb" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/HRxK0JXb86fWgJkb (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:03:26.533Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:26.533860Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:26.534Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:26.533860Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:26.534Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userdcae HTTP/1.1 SC="500" 2021-04-14T11:03:26.641Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b98822eb-cba1-4be0-9e8c-3ae8e6cab81a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:26.640977Z InvocationID=2028bbd8-f929-491a-b681-f763aa7bb5ab LogTimestamp=2021-04-14T11:03:26.641075Z Entering 2021-04-14T11:03:26.641Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b98822eb-cba1-4be0-9e8c-3ae8e6cab81a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:26.640977Z InvocationID=2028bbd8-f929-491a-b681-f763aa7bb5ab LogTimestamp=2021-04-14T11:03:26.641075Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:26.647Z [qtp580718781-14] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "CONSUMER" API_KEY = "HRxK0JXb86fWgJkb" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:03:26.714Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "SO-COpenSource-Env11" API_KEY = "HRxK0JXb86fWgJkb" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=2170 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:03:24.543Z InvocationID=7081d42b-2a60-42a1-a0f8-382299267b4b LogTimestamp=2021-04-14T11:03:26.713966Z ResponseDesc=OK Exiting. 2021-04-14T11:03:26.715Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:03:26.837Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:26.641Z InvocationID=4a2624e3-5422-43ba-be8c-cc4faf03e44a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id dcae 2021-04-14T11:03:27.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53615730-bfae-4be7-8444-bb0899d165dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:27.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53615730-bfae-4be7-8444-bb0899d165dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f28ca53 2021-04-14T11:03:27.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53615730-bfae-4be7-8444-bb0899d165dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:27.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53615730-bfae-4be7-8444-bb0899d165dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:27.831Z [qtp580718781-12] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:26.641Z InvocationID=4a2624e3-5422-43ba-be8c-cc4faf03e44a ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node dcae. status returned is NOT_FOUND 2021-04-14T11:03:29.333Z [qtp580718781-12] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "dcae,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:26.641Z InvocationID=4a2624e3-5422-43ba-be8c-cc4faf03e44a ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:30.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:30.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d92f784 2021-04-14T11:03:30.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:30.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:30.443Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "dcae,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=3801 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:26.641Z InvocationID=4a2624e3-5422-43ba-be8c-cc4faf03e44a ErrorCode=500 LogTimestamp=2021-04-14T11:03:30.442824Z ResponseDesc=Created Exiting. 2021-04-14T11:03:30.443Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:30.535Z [qtp580718781-11] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:30.535022Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:30.535Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:30.535022Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:30.535Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usermso HTTP/1.1 SC="500" 2021-04-14T11:03:30.551Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7b336f38-32ec-4c1a-b306-8d57f19631b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:30.550902Z InvocationID=22b4e6f9-ceeb-4a3a-9fe6-aa2d84408d9a LogTimestamp=2021-04-14T11:03:30.551019Z Entering 2021-04-14T11:03:30.555Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7b336f38-32ec-4c1a-b306-8d57f19631b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:30.550902Z InvocationID=22b4e6f9-ceeb-4a3a-9fe6-aa2d84408d9a LogTimestamp=2021-04-14T11:03:30.551019Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:30.631Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:30.555Z InvocationID=876b6609-f3da-4ca7-968f-b0086cf1420e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id mso 2021-04-14T11:03:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:03:31.571Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:03:32.033Z [qtp580718781-18] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:30.555Z InvocationID=876b6609-f3da-4ca7-968f-b0086cf1420e ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node mso. status returned is NOT_FOUND 2021-04-14T11:03:32.553Z [qtp580718781-18] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "mso,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:30.555Z InvocationID=876b6609-f3da-4ca7-968f-b0086cf1420e ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:33.142Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:03:33.143Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:03:33.143Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:33.143Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c0315320-397a-44be-9ebd-8c6f7e7df11d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:33.419Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "mso,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2863 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:30.555Z InvocationID=876b6609-f3da-4ca7-968f-b0086cf1420e ErrorCode=500 LogTimestamp=2021-04-14T11:03:33.418873Z ResponseDesc=Created Exiting. 2021-04-14T11:03:33.421Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:33.525Z [qtp580718781-13] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:33.525851Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:33.526Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:33.525851Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:33.526Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usersdnc HTTP/1.1 SC="500" 2021-04-14T11:03:33.547Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=820f4ca2-da4e-4f70-bff2-42585bbe601d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:33.546684Z InvocationID=d1f1901a-3992-46fb-8b64-d2154a8efdab LogTimestamp=2021-04-14T11:03:33.546778Z Entering 2021-04-14T11:03:33.547Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=820f4ca2-da4e-4f70-bff2-42585bbe601d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:33.546684Z InvocationID=d1f1901a-3992-46fb-8b64-d2154a8efdab LogTimestamp=2021-04-14T11:03:33.546778Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:33.614Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:33.547Z InvocationID=dcd52d24-b2b8-4451-94dd-fda761da4902 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id sdnc 2021-04-14T11:03:33.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807703ca-3c6a-4e2f-a836-2c6c0207da23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:33.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807703ca-3c6a-4e2f-a836-2c6c0207da23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12e02d19 2021-04-14T11:03:33.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807703ca-3c6a-4e2f-a836-2c6c0207da23 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:33.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807703ca-3c6a-4e2f-a836-2c6c0207da23 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:34.218Z [qtp580718781-16] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:33.547Z InvocationID=dcd52d24-b2b8-4451-94dd-fda761da4902 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node sdnc. status returned is NOT_FOUND 2021-04-14T11:03:34.723Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=807703ca-3c6a-4e2f-a836-2c6c0207da23 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:34.723Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=807703ca-3c6a-4e2f-a836-2c6c0207da23 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:34.794Z [qtp580718781-16] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "sdnc,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:33.547Z InvocationID=dcd52d24-b2b8-4451-94dd-fda761da4902 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:35.687Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "sdnc,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2140 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:33.547Z InvocationID=dcd52d24-b2b8-4451-94dd-fda761da4902 ErrorCode=500 LogTimestamp=2021-04-14T11:03:35.687338Z ResponseDesc=Created Exiting. 2021-04-14T11:03:35.688Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:35.709Z [qtp580718781-15] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:35.709257Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:35.709Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:35.709257Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:35.710Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/uservid HTTP/1.1 SC="500" 2021-04-14T11:03:35.721Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=48e8ec6b-e0cf-4afc-b65e-35491cf66be3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:35.721253Z InvocationID=e424435f-4b31-480b-baed-85feed841903 LogTimestamp=2021-04-14T11:03:35.721337Z Entering 2021-04-14T11:03:35.721Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=48e8ec6b-e0cf-4afc-b65e-35491cf66be3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:35.721253Z InvocationID=e424435f-4b31-480b-baed-85feed841903 LogTimestamp=2021-04-14T11:03:35.721337Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:35.729Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:35.721Z InvocationID=2a8da5b9-34f8-4438-add4-876f9f9b869f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id vid 2021-04-14T11:03:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d9042e2 2021-04-14T11:03:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:36.303Z [qtp580718781-19] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:35.721Z InvocationID=2a8da5b9-34f8-4438-add4-876f9f9b869f ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node vid. status returned is NOT_FOUND 2021-04-14T11:03:37.507Z [qtp580718781-19] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "vid,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:35.721Z InvocationID=2a8da5b9-34f8-4438-add4-876f9f9b869f ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:38.184Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "vid,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2462 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:35.721Z InvocationID=2a8da5b9-34f8-4438-add4-876f9f9b869f ErrorCode=500 LogTimestamp=2021-04-14T11:03:38.183568Z ResponseDesc=Created Exiting. 2021-04-14T11:03:38.185Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:38.203Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:38.203568Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:38.203Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:38.203568Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:38.204Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usercognita HTTP/1.1 SC="500" 2021-04-14T11:03:38.222Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0a2f18df-1fa6-4ea9-8dab-be60c08b0498 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:38.221567Z InvocationID=bc2b795a-abb3-4f5a-9498-32bb48712f28 LogTimestamp=2021-04-14T11:03:38.221655Z Entering 2021-04-14T11:03:38.222Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0a2f18df-1fa6-4ea9-8dab-be60c08b0498 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:38.221567Z InvocationID=bc2b795a-abb3-4f5a-9498-32bb48712f28 LogTimestamp=2021-04-14T11:03:38.221655Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:38.232Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:38.222Z InvocationID=fb8bee5e-941d-4e12-8c45-85ad7df9533a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id cognita 2021-04-14T11:03:38.786Z [qtp580718781-14] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:38.222Z InvocationID=fb8bee5e-941d-4e12-8c45-85ad7df9533a ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node cognita. status returned is NOT_FOUND 2021-04-14T11:03:38.993Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:03:38.993Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:03:38.994Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:38.994Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5f65c61a-b953-4000-9909-0602b5b51dd3 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:03:39.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58480c51-e268-4f86-8f38-0dcab64226f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:39.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58480c51-e268-4f86-8f38-0dcab64226f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b4aa03 2021-04-14T11:03:39.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58480c51-e268-4f86-8f38-0dcab64226f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:39.171Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58480c51-e268-4f86-8f38-0dcab64226f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:39.303Z [qtp580718781-14] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "cognita,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:38.222Z InvocationID=fb8bee5e-941d-4e12-8c45-85ad7df9533a ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:39.850Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "cognita,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1628 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:38.222Z InvocationID=fb8bee5e-941d-4e12-8c45-85ad7df9533a ErrorCode=500 LogTimestamp=2021-04-14T11:03:39.850284Z ResponseDesc=Created Exiting. 2021-04-14T11:03:39.851Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:39.864Z [qtp580718781-15] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:39.864358Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:39.864Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:39.864358Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:39.865Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userclamp HTTP/1.1 SC="500" 2021-04-14T11:03:39.878Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=730fec98-99d0-4549-80e3-f2311e0e9ec0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:39.877644Z InvocationID=1f7bf4c0-8e6e-49b3-b650-e2d2fc8ed0f9 LogTimestamp=2021-04-14T11:03:39.877738Z Entering 2021-04-14T11:03:39.878Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=730fec98-99d0-4549-80e3-f2311e0e9ec0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:39.877644Z InvocationID=1f7bf4c0-8e6e-49b3-b650-e2d2fc8ed0f9 LogTimestamp=2021-04-14T11:03:39.877738Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:39.887Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:39.878Z InvocationID=8c7c275b-aab7-429a-a812-05e8650d5f3b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id clamp 2021-04-14T11:03:40.409Z [qtp580718781-13] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:39.878Z InvocationID=8c7c275b-aab7-429a-a812-05e8650d5f3b ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node clamp. status returned is NOT_FOUND 2021-04-14T11:03:40.926Z [qtp580718781-13] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "clamp,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:39.878Z InvocationID=8c7c275b-aab7-429a-a812-05e8650d5f3b ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:41.471Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "clamp,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1593 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:39.878Z InvocationID=8c7c275b-aab7-429a-a812-05e8650d5f3b ErrorCode=500 LogTimestamp=2021-04-14T11:03:41.471071Z ResponseDesc=Created Exiting. 2021-04-14T11:03:41.471Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:41.484Z [qtp580718781-18] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:41.484713Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:41.484Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:41.484713Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:41.485Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/uservfc HTTP/1.1 SC="500" 2021-04-14T11:03:41.497Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=12177abf-a55d-46f7-ada9-3f8f03f031f4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:41.497291Z InvocationID=e84ef087-385d-4410-93e1-7e9af2a8550f LogTimestamp=2021-04-14T11:03:41.497380Z Entering 2021-04-14T11:03:41.497Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=12177abf-a55d-46f7-ada9-3f8f03f031f4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:41.497291Z InvocationID=e84ef087-385d-4410-93e1-7e9af2a8550f LogTimestamp=2021-04-14T11:03:41.497380Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:41.507Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:41.498Z InvocationID=c76b6e33-bc22-4935-b2bf-4ec18a05986d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id vfc 2021-04-14T11:03:42.032Z [qtp580718781-12] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:41.498Z InvocationID=c76b6e33-bc22-4935-b2bf-4ec18a05986d ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node vfc. status returned is NOT_FOUND 2021-04-14T11:03:42.181Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=58480c51-e268-4f86-8f38-0dcab64226f2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:03:42.181Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=58480c51-e268-4f86-8f38-0dcab64226f2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:03:42.614Z [qtp580718781-12] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "vfc,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:41.498Z InvocationID=c76b6e33-bc22-4935-b2bf-4ec18a05986d ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:42.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816a4682-a4a4-42ca-a390-c0404e1066dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:42.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816a4682-a4a4-42ca-a390-c0404e1066dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b502d21 2021-04-14T11:03:42.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816a4682-a4a4-42ca-a390-c0404e1066dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:42.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816a4682-a4a4-42ca-a390-c0404e1066dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:43.226Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "vfc,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1727 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:41.498Z InvocationID=c76b6e33-bc22-4935-b2bf-4ec18a05986d ErrorCode=500 LogTimestamp=2021-04-14T11:03:43.225693Z ResponseDesc=Created Exiting. 2021-04-14T11:03:43.226Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:43.238Z [qtp580718781-11] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:43.238788Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:43.239Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:43.238788Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:43.239Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userworkflow HTTP/1.1 SC="500" 2021-04-14T11:03:43.316Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1b33fe77-d5a7-4bc2-924b-0e8b3888725d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:43.315599Z InvocationID=58aecdd5-9101-4273-983e-58436d0b4a9c LogTimestamp=2021-04-14T11:03:43.315707Z Entering 2021-04-14T11:03:43.316Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1b33fe77-d5a7-4bc2-924b-0e8b3888725d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:43.315599Z InvocationID=58aecdd5-9101-4273-983e-58436d0b4a9c LogTimestamp=2021-04-14T11:03:43.315707Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:43.327Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:43.317Z InvocationID=09771032-18d2-49bf-8985-b50a2e649d8d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id workflow 2021-04-14T11:03:43.930Z [qtp580718781-19] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:43.317Z InvocationID=09771032-18d2-49bf-8985-b50a2e649d8d ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node workflow. status returned is NOT_FOUND 2021-04-14T11:03:44.448Z [qtp580718781-19] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "workflow,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:43.317Z InvocationID=09771032-18d2-49bf-8985-b50a2e649d8d ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:45.237Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "workflow,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1919 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:43.317Z InvocationID=09771032-18d2-49bf-8985-b50a2e649d8d ErrorCode=500 LogTimestamp=2021-04-14T11:03:45.236821Z ResponseDesc=Created Exiting. 2021-04-14T11:03:45.237Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:45.383Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:45.383669Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:45.383Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:45.383669Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:45.384Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userpolicy HTTP/1.1 SC="500" 2021-04-14T11:03:45.438Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=22f37423-43ca-4628-b174-39b2e6b4b425 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:45.438339Z InvocationID=5d5c7894-07d6-47ad-a0d9-022e8e041ae6 LogTimestamp=2021-04-14T11:03:45.438443Z Entering 2021-04-14T11:03:45.439Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=22f37423-43ca-4628-b174-39b2e6b4b425 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:45.438339Z InvocationID=5d5c7894-07d6-47ad-a0d9-022e8e041ae6 LogTimestamp=2021-04-14T11:03:45.438443Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:45.637Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=816a4682-a4a4-42ca-a390-c0404e1066dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:03:45.637Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=816a4682-a4a4-42ca-a390-c0404e1066dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:03:45.684Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:45.440Z InvocationID=a90826a0-7dbb-46c7-bd8b-3fe0785b2b24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id policy 2021-04-14T11:03:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:03:46.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8723851-6f93-45b2-884d-f16768630283 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:46.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8723851-6f93-45b2-884d-f16768630283 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@761eafd1 2021-04-14T11:03:46.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8723851-6f93-45b2-884d-f16768630283 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:46.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8723851-6f93-45b2-884d-f16768630283 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:46.611Z [qtp580718781-16] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:45.440Z InvocationID=a90826a0-7dbb-46c7-bd8b-3fe0785b2b24 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node policy. status returned is NOT_FOUND 2021-04-14T11:03:47.240Z [qtp580718781-16] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "policy,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:45.440Z InvocationID=a90826a0-7dbb-46c7-bd8b-3fe0785b2b24 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:48.240Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "policy,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2799 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:45.440Z InvocationID=a90826a0-7dbb-46c7-bd8b-3fe0785b2b24 ErrorCode=500 LogTimestamp=2021-04-14T11:03:48.239654Z ResponseDesc=Created Exiting. 2021-04-14T11:03:48.240Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:48.440Z [qtp580718781-14] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:48.439919Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:48.440Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:48.439919Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:48.440Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/userpomba HTTP/1.1 SC="500" 2021-04-14T11:03:48.590Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b9837fce-9f80-42c8-88cf-54dfc9a83baa InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:48.590313Z InvocationID=43060ce7-a2bc-461e-8b0d-ebef39486e91 LogTimestamp=2021-04-14T11:03:48.590397Z Entering 2021-04-14T11:03:48.591Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b9837fce-9f80-42c8-88cf-54dfc9a83baa InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:48.590313Z InvocationID=43060ce7-a2bc-461e-8b0d-ebef39486e91 LogTimestamp=2021-04-14T11:03:48.590397Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:48.631Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:48.592Z InvocationID=1414b587-c7b1-4f64-9e8d-3ce25159d659 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id pomba 2021-04-14T11:03:49.412Z [qtp580718781-15] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:48.592Z InvocationID=1414b587-c7b1-4f64-9e8d-3ce25159d659 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node pomba. status returned is NOT_FOUND 2021-04-14T11:03:49.497Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b8723851-6f93-45b2-884d-f16768630283 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:03:49.497Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b8723851-6f93-45b2-884d-f16768630283 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:03:50.014Z [qtp580718781-15] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "pomba,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:48.592Z InvocationID=1414b587-c7b1-4f64-9e8d-3ce25159d659 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:50.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2ac433f-9302-48c8-b2fe-aadb33265469 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:50.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2ac433f-9302-48c8-b2fe-aadb33265469 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4600a60c 2021-04-14T11:03:50.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2ac433f-9302-48c8-b2fe-aadb33265469 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:50.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2ac433f-9302-48c8-b2fe-aadb33265469 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:50.992Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d7e6a4ff-7a8f-41ee-808f-18be2d4184d1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=policy ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.171 StatusCode=INPROGRESS RemoteHost=10.242.228.171 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:50.992311Z InvocationID=ecf17841-5281-4d5f-a9c1-201d3db64cf1 LogTimestamp=2021-04-14T11:03:50.992426Z Entering 2021-04-14T11:03:50.992Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d7e6a4ff-7a8f-41ee-808f-18be2d4184d1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=policy ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.171 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.171 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:50.992311Z InvocationID=ecf17841-5281-4d5f-a9c1-201d3db64cf1 LogTimestamp=2021-04-14T11:03:50.992426Z localAddr=10.242.62.146 remoteAddr=10.242.228.171 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:03:50.994Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:03:50.993Z InvocationID=c582a3d6-ceed-4bf4-b65d-f48b758c182b LogTimestamp=2021-04-14T11:03:50.994194Z ResponseDesc=OK Exiting. 2021-04-14T11:03:50.994Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:03:51.016Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "pomba,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2423 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:48.592Z InvocationID=1414b587-c7b1-4f64-9e8d-3ce25159d659 ErrorCode=500 LogTimestamp=2021-04-14T11:03:51.015847Z ResponseDesc=Created Exiting. 2021-04-14T11:03:51.017Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:51.134Z [qtp580718781-16] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:51.134460Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:51.134Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:51.134460Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:51.135Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usermulticloud HTTP/1.1 SC="500" 2021-04-14T11:03:51.217Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=35b999e7-9e51-4e35-a3df-76eaee3eea07 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:51.217226Z InvocationID=5aede60a-6b6d-444f-9443-9304d09e6830 LogTimestamp=2021-04-14T11:03:51.217318Z Entering 2021-04-14T11:03:51.217Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=35b999e7-9e51-4e35-a3df-76eaee3eea07 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:51.217226Z InvocationID=5aede60a-6b6d-444f-9443-9304d09e6830 LogTimestamp=2021-04-14T11:03:51.217318Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:51.234Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:51.218Z InvocationID=a086fc92-f08a-4dbc-aaea-d816267f7fce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id multicloud 2021-04-14T11:03:51.752Z [qtp580718781-14] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:51.218Z InvocationID=a086fc92-f08a-4dbc-aaea-d816267f7fce ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node multicloud. status returned is NOT_FOUND 2021-04-14T11:03:52.320Z [qtp580718781-14] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "multicloud,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:51.218Z InvocationID=a086fc92-f08a-4dbc-aaea-d816267f7fce ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:53.015Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "multicloud,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1796 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:51.218Z InvocationID=a086fc92-f08a-4dbc-aaea-d816267f7fce ErrorCode=500 LogTimestamp=2021-04-14T11:03:53.014799Z ResponseDesc=Created Exiting. 2021-04-14T11:03:53.015Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:53.026Z [qtp580718781-12] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:53.026126Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:53.026Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:53.026126Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:53.026Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usercds HTTP/1.1 SC="500" 2021-04-14T11:03:53.118Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5d783c6b-5bf6-4497-95cf-07905c6005f5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:53.118430Z InvocationID=5ad3e1b1-3acb-4242-a8bf-d08d4a5d39a3 LogTimestamp=2021-04-14T11:03:53.118499Z Entering 2021-04-14T11:03:53.118Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5d783c6b-5bf6-4497-95cf-07905c6005f5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:53.118430Z InvocationID=5ad3e1b1-3acb-4242-a8bf-d08d4a5d39a3 LogTimestamp=2021-04-14T11:03:53.118499Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:53.126Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:53.119Z InvocationID=ed6709d5-a707-4ec9-affe-1946d5ddec77 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id cds 2021-04-14T11:03:53.226Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e2ac433f-9302-48c8-b2fe-aadb33265469 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:03:53.227Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e2ac433f-9302-48c8-b2fe-aadb33265469 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:03:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccd00aa-2d26-426c-b267-60f3b1269d4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccd00aa-2d26-426c-b267-60f3b1269d4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56b71f40 2021-04-14T11:03:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccd00aa-2d26-426c-b267-60f3b1269d4a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ccd00aa-2d26-426c-b267-60f3b1269d4a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:54.187Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information. 2021-04-14T11:03:54.410Z [qtp580718781-13] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:53.119Z InvocationID=ed6709d5-a707-4ec9-affe-1946d5ddec77 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node cds. status returned is NOT_FOUND 2021-04-14T11:03:54.990Z [qtp580718781-13] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "cds,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:53.119Z InvocationID=ed6709d5-a707-4ec9-affe-1946d5ddec77 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:55.596Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "cds,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=2477 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:53.119Z InvocationID=ed6709d5-a707-4ec9-affe-1946d5ddec77 ErrorCode=500 LogTimestamp=2021-04-14T11:03:55.596116Z ResponseDesc=Created Exiting. 2021-04-14T11:03:55.597Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:55.610Z [qtp580718781-16] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:55.610167Z StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:03:55.610Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:03:55.610167Z StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:03:55.610Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/usermodeling HTTP/1.1 SC="500" 2021-04-14T11:03:55.621Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3163d918-6c2d-4fa2-bf1d-8b22abafc94e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:55.621641Z InvocationID=cd79af4d-2457-4c3a-b958-ad2cebe062a8 LogTimestamp=2021-04-14T11:03:55.621705Z Entering 2021-04-14T11:03:55.622Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3163d918-6c2d-4fa2-bf1d-8b22abafc94e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/consumers ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:55.621641Z InvocationID=cd79af4d-2457-4c3a-b958-ad2cebe062a8 LogTimestamp=2021-04-14T11:03:55.621705Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/consumers HTTP/1.1 2021-04-14T11:03:55.698Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers EntryTimestamp=2021-04-14T11:03:55.622Z InvocationID=3f2b7bfd-72eb-470c-985a-cba5817f0767 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id modeling 2021-04-14T11:03:56.300Z [qtp580718781-14] ERROR o.o.s.b.m.o.impl.ConsumerOperation RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:55.622Z InvocationID=3f2b7bfd-72eb-470c-985a-cba5817f0767 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Error returned after get Consumer Data node modeling. status returned is NOT_FOUND 2021-04-14T11:03:56.817Z [qtp580718781-14] WARN o.o.s.b.a.impl.AuditingManager AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "modeling,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:55.622Z InvocationID=3f2b7bfd-72eb-470c-985a-cba5817f0767 ErrorCode=500 Failed to persist to cassandra auditing event: GENERAL_ERROR 2021-04-14T11:03:57.041Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2ccd00aa-2d26-426c-b267-60f3b1269d4a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:03:57.041Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2ccd00aa-2d26-426c-b267-60f3b1269d4a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:03:57.583Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "AddECOMPUserCredentials" MODIFIER = "Jimmy Hendrix(jh0003)" ECOMP_USER = "modeling,9cd4c3ad2a6f6ce3f3414e68b5157e63,35371c046f88c603ccba152cb3db34ec4475cb2e5713f2fc0a43bf18a5243495" STATUS = "201" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=1961 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/consumers TargetServiceName=null EntryTimestamp=2021-04-14T11:03:55.622Z InvocationID=3f2b7bfd-72eb-470c-985a-cba5817f0767 ErrorCode=500 LogTimestamp=2021-04-14T11:03:57.583511Z ResponseDesc=Created Exiting. 2021-04-14T11:03:57.584Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/consumers HTTP/1.1 SC="201" 2021-04-14T11:03:57.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:03:57.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@146adfa2 2021-04-14T11:03:57.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:03:57.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:03:58.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4d50c1f2-7a97-4365-a213-93ff34f570c3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/user/jh0003 ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:58.235336Z InvocationID=e29515fe-0955-4a5a-89c4-525ec4f3d537 LogTimestamp=2021-04-14T11:03:58.235409Z Entering 2021-04-14T11:03:58.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4d50c1f2-7a97-4365-a213-93ff34f570c3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/user/jh0003 ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:58.235336Z InvocationID=e29515fe-0955-4a5a-89c4-525ec4f3d537 LogTimestamp=2021-04-14T11:03:58.235409Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 GET /sdc2/rest/v1/user/jh0003 HTTP/1.1 2021-04-14T11:03:58.243Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/user/jh0003 EntryTimestamp=2021-04-14T11:03:58.235Z InvocationID=51dd42dc-4ddd-411e-842e-9957db722f88 LogTimestamp=2021-04-14T11:03:58.243384Z ResponseDesc=OK Exiting. 2021-04-14T11:03:58.243Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/user/jh0003 HTTP/1.1 SC="200" 2021-04-14T11:03:58.699Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=65c66c29-883e-4eb4-aaa2-9fb3d9adf38a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/screen ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:58.699298Z InvocationID=c208d70e-6d3d-4e9b-848b-4141f83342dd LogTimestamp=2021-04-14T11:03:58.699410Z Entering 2021-04-14T11:03:58.700Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=65c66c29-883e-4eb4-aaa2-9fb3d9adf38a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/screen ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:58.699298Z InvocationID=c208d70e-6d3d-4e9b-848b-4141f83342dd LogTimestamp=2021-04-14T11:03:58.699410Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 GET /sdc2/rest/v1/screen HTTP/1.1 2021-04-14T11:03:58.791Z [qtp580718781-12] INFO o.o.s.b.m.j.o.ToscaElementOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/screen EntryTimestamp=2021-04-14T11:03:58.700Z InvocationID=9658c819-0597-40fc-990d-45a2e3072c9b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m time to fetch all catalog elements: StopWatch '': running time = 12990758 ns\n---------------------------------------------\nns % Task name\n---------------------------------------------\n012990758 100% \n 2021-04-14T11:03:58.801Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/screen EntryTimestamp=2021-04-14T11:03:58.700Z InvocationID=9658c819-0597-40fc-990d-45a2e3072c9b LogTimestamp=2021-04-14T11:03:58.801603Z ResponseDesc=OK Exiting. 2021-04-14T11:03:58.802Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc2/rest/v1/screen HTTP/1.1 SC="200" 2021-04-14T11:03:58.823Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3b54e6ca-32ba-4e74-953d-4e059166acc9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/datatypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:58.822978Z InvocationID=bb82c7bf-06f5-4ec3-b06f-c354b63a3f2f LogTimestamp=2021-04-14T11:03:58.823030Z Entering 2021-04-14T11:03:58.823Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3b54e6ca-32ba-4e74-953d-4e059166acc9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/datatypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:03:58.822978Z InvocationID=bb82c7bf-06f5-4ec3-b06f-c354b63a3f2f LogTimestamp=2021-04-14T11:03:58.823030Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/datatypes HTTP/1.1 2021-04-14T11:03:59.213Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.Root to dao for create 2021-04-14T11:03:59.283Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : integer to dao for create 2021-04-14T11:03:59.684Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : string to dao for create 2021-04-14T11:03:59.698Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : boolean to dao for create 2021-04-14T11:03:59.710Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : float to dao for create 2021-04-14T11:03:59.724Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : list to dao for create 2021-04-14T11:03:59.739Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : map to dao for create 2021-04-14T11:03:59.753Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : json to dao for create 2021-04-14T11:03:59.767Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : scalar-unit to dao for create 2021-04-14T11:03:59.784Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : scalar-unit.size to dao for create 2021-04-14T11:03:59.799Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : scalar-unit.time to dao for create 2021-04-14T11:03:59.815Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : scalar-unit.frequency to dao for create 2021-04-14T11:03:59.827Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.Credential to dao for create 2021-04-14T11:03:59.932Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.PortMirroringConnectionPointDescription to dao for create 2021-04-14T11:03:59.981Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.TimeInterval to dao for create 2021-04-14T11:04:00.008Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.network.NetworkInfo to dao for create 2021-04-14T11:04:00.038Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.network.PortInfo to dao for create 2021-04-14T11:04:00.080Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.network.PortDef to dao for create 2021-04-14T11:04:00.088Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.network.PortSpec to dao for create 2021-04-14T11:04:00.154Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.AddressPair to dao for create 2021-04-14T11:04:00.182Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.subnet.HostRoute to dao for create 2021-04-14T11:04:00.206Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.AllocationPool to dao for create 2021-04-14T11:04:00.230Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.neutron.Subnet to dao for create 2021-04-14T11:04:00.324Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.novaServer.network.PortExtraProperties to dao for create 2021-04-14T11:04:00.372Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.novaServer.network.AddressInfo to dao for create 2021-04-14T11:04:00.382Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.neutron.port.FixedIps to dao for create 2021-04-14T11:04:00.404Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.FileInfo to dao for create 2021-04-14T11:04:00.424Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrail.network.rule.PortPairs to dao for create 2021-04-14T11:04:00.443Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrail.network.rule.Rule to dao for create 2021-04-14T11:04:00.498Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrail.network.rule.RuleList to dao for create 2021-04-14T11:04:00.511Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrail.network.rule.VirtualNetwork to dao for create 2021-04-14T11:04:00.524Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.neutron.SecurityRules.Rule to dao for create 2021-04-14T11:04:00.593Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.substitution.SubstitutionFiltering to dao for create 2021-04-14T11:04:00.658Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.network.rule.RefDataSequence to dao for create 2021-04-14T11:04:00.682Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.network.rule.RefData to dao for create 2021-04-14T11:04:00.698Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.network.rule.ref.data.IpamSubnet to dao for create 2021-04-14T11:04:00.715Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.network.rule.ref.data.IpamSubnetList to dao for create 2021-04-14T11:04:00.739Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.network.rule.IpamRefData to dao for create 2021-04-14T11:04:00.753Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.SrcVirtualNetwork to dao for create 2021-04-14T11:04:00.774Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.DstVirtualNetwork to dao for create 2021-04-14T11:04:00.793Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.DstPortPairs to dao for create 2021-04-14T11:04:00.807Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:04:00.807Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:04:00.808Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:04:00.808Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2c3eb978-53f8-409d-8df6-f3d9d8bff66a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:04:00.817Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.SrcPortPairs to dao for create 2021-04-14T11:04:00.839Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.ActionList to dao for create 2021-04-14T11:04:00.899Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.Rule to dao for create 2021-04-14T11:04:01.105Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.network.rule.RuleList to dao for create 2021-04-14T11:04:01.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a789e33d-c69f-4a49-908d-d3eb0c7c0ab1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:01.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a789e33d-c69f-4a49-908d-d3eb0c7c0ab1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d7ae535 2021-04-14T11:04:01.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a789e33d-c69f-4a49-908d-d3eb0c7c0ab1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:01.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a789e33d-c69f-4a49-908d-d3eb0c7c0ab1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:01.116Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.contrail.port.StaticRoute to dao for create 2021-04-14T11:04:01.200Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.contrail.AddressPair to dao for create 2021-04-14T11:04:01.219Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.network.contrail.InterfaceData to dao for create 2021-04-14T11:04:01.242Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.machine.interface.Properties to dao for create 2021-04-14T11:04:01.294Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.Root to dao for create 2021-04-14T11:04:01.319Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.AssignmentRequirements to dao for create 2021-04-14T11:04:01.339Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.SubnetAssignments to dao for create 2021-04-14T11:04:01.402Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.IPv4SubnetAssignments to dao for create 2021-04-14T11:04:01.418Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.IPv6SubnetAssignments to dao for create 2021-04-14T11:04:01.432Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.NetworkAssignments to dao for create 2021-04-14T11:04:01.487Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.ProviderNetwork to dao for create 2021-04-14T11:04:01.519Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.NetworkFlows to dao for create 2021-04-14T11:04:01.546Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.VlanRequirements to dao for create 2021-04-14T11:04:01.575Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.IpRequirements to dao for create 2021-04-14T11:04:01.674Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.MacAssignments to dao for create 2021-04-14T11:04:01.692Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.CSProperties to dao for create 2021-04-14T11:04:01.761Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.NSCapabilities to dao for create 2021-04-14T11:04:01.853Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.NSSCapabilities to dao for create 2021-04-14T11:04:01.946Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.ServiceProfile to dao for create 2021-04-14T11:04:02.034Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.SliceProfile to dao for create 2021-04-14T11:04:02.143Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.EcompHoming to dao for create 2021-04-14T11:04:02.162Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.EcompNaming to dao for create 2021-04-14T11:04:02.178Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.MacRequirements to dao for create 2021-04-14T11:04:02.222Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.machine.subInterface.AddressPairIp to dao for create 2021-04-14T11:04:02.239Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.machine.subInterface.MacAddress to dao for create 2021-04-14T11:04:02.252Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.machine.subInterface.Properties to dao for create 2021-04-14T11:04:02.262Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.machine.subInterface.AddressPair to dao for create 2021-04-14T11:04:02.336Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.heat.contrailV2.virtual.machine.subInterface.AddressPairs to dao for create 2021-04-14T11:04:02.348Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.Naming to dao for create 2021-04-14T11:04:02.381Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:04:02.383Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:04:02.428Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.flavors.ComputeFlavor to dao for create 2021-04-14T11:04:02.444Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.flavors.LicenseFlavor to dao for create 2021-04-14T11:04:02.454Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.flavors.VendorInfo to dao for create 2021-04-14T11:04:02.467Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.flavors.DeploymentFlavor to dao for create 2021-04-14T11:04:02.542Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.ImageInfo to dao for create 2021-04-14T11:04:02.562Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : org.openecomp.datatypes.network.RelatedNetworksAssignments to dao for create 2021-04-14T11:04:02.572Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfcAdditionalConfigurableProperties to dao for create 2021-04-14T11:04:02.621Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfcConfigurableProperties to dao for create 2021-04-14T11:04:02.635Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.RequestedAdditionalCapability to dao for create 2021-04-14T11:04:02.660Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VirtualMemory to dao for create 2021-04-14T11:04:02.737Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VirtualCpuPinning to dao for create 2021-04-14T11:04:02.828Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VirtualCpu to dao for create 2021-04-14T11:04:02.931Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.LogicalNodeData to dao for create 2021-04-14T11:04:03.021Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VirtualNetworkInterfaceRequirements to dao for create 2021-04-14T11:04:03.036Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:04:03.037Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:04:03.052Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:04:03.052Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster. 2021-04-14T11:04:03.119Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.injectFile to dao for create 2021-04-14T11:04:03.135Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.L2AddressData to dao for create 2021-04-14T11:04:03.146Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.L3AddressData to dao for create 2021-04-14T11:04:03.243Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.AddressData to dao for create 2021-04-14T11:04:03.325Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ConnectivityType to dao for create 2021-04-14T11:04:03.339Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VlFlavour to dao for create 2021-04-14T11:04:03.347Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.AddressPairs to dao for create 2021-04-14T11:04:03.422Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.FloatingIP to dao for create 2021-04-14T11:04:03.432Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.LocationInfo to dao for create 2021-04-14T11:04:03.515Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.HostRouteInfo to dao for create 2021-04-14T11:04:03.530Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.InjectData to dao for create 2021-04-14T11:04:03.615Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.zte.WatchDog to dao for create 2021-04-14T11:04:03.626Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ext.LocalAffinityOrAntiAffinityRule to dao for create 2021-04-14T11:04:03.640Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VduProfile to dao for create 2021-04-14T11:04:03.736Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.LinkBitrateRequirements to dao for create 2021-04-14T11:04:03.821Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.Qos to dao for create 2021-04-14T11:04:03.839Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.IpAllocationPool to dao for create 2021-04-14T11:04:03.946Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.L2ProtocolData to dao for create 2021-04-14T11:04:04.120Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.L3ProtocolData to dao for create 2021-04-14T11:04:04.124Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a789e33d-c69f-4a49-908d-d3eb0c7c0ab1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:04:04.124Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a789e33d-c69f-4a49-908d-d3eb0c7c0ab1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:04:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:04:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:04:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:04.631Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VirtualLinkProtocolData to dao for create 2021-04-14T11:04:04.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:04.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5134d07b 2021-04-14T11:04:04.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:04.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:04.938Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VlProfile to dao for create 2021-04-14T11:04:05.188Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VduLevel to dao for create 2021-04-14T11:04:05.237Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ScaleInfo to dao for create 2021-04-14T11:04:05.246Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2e6bedcc-c8cc-4857-bd72-95f4785d28da InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=policy ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.171 StatusCode=INPROGRESS RemoteHost=10.242.228.171 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:05.245672Z InvocationID=3bcb869b-faf9-4e8d-af20-1979a1b557de LogTimestamp=2021-04-14T11:04:05.245770Z Entering 2021-04-14T11:04:05.246Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2e6bedcc-c8cc-4857-bd72-95f4785d28da InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=policy ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.171 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.171 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:05.245672Z InvocationID=3bcb869b-faf9-4e8d-af20-1979a1b557de LogTimestamp=2021-04-14T11:04:05.245770Z localAddr=10.242.62.146 remoteAddr=10.242.228.171 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:04:05.251Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/ojrRkC7JO1J4gx7V will send credentials over a clear channel. 2021-04-14T11:04:05.251Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/ojrRkC7JO1J4gx7V (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:05.253Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.ScalingAspect to dao for create 2021-04-14T11:04:05.537Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.InstantiationLevel to dao for create 2021-04-14T11:04:05.834Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfInstantiateOperationConfiguration to dao for create 2021-04-14T11:04:05.839Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:05.848Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "ojrRkC7JO1J4gx7V" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/ojrRkC7JO1J4gx7V will send credentials over a clear channel. 2021-04-14T11:04:05.848Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "ojrRkC7JO1J4gx7V" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/ojrRkC7JO1J4gx7V (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:05.892Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "ojrRkC7JO1J4gx7V" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:05.934Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfScaleOperationConfiguration to dao for create 2021-04-14T11:04:05.982Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "policy-id" API_KEY = "ojrRkC7JO1J4gx7V" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=736 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:05.246Z InvocationID=ae09b594-7ab3-4cc7-be87-9795fe32e181 LogTimestamp=2021-04-14T11:04:05.982595Z ResponseDesc=OK Exiting. 2021-04-14T11:04:05.983Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:04:06.036Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfScaleToLevelOperationConfiguration to dao for create 2021-04-14T11:04:06.187Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfHealOperationConfiguration to dao for create 2021-04-14T11:04:06.217Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfTerminateOperationConfiguration to dao for create 2021-04-14T11:04:06.417Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfOperateOperationConfiguration to dao for create 2021-04-14T11:04:06.440Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfChangeFlavourOperationConfiguration to dao for create 2021-04-14T11:04:06.538Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfProfile to dao for create 2021-04-14T11:04:06.842Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.UriAuthority to dao for create 2021-04-14T11:04:07.015Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.UriComponents to dao for create 2021-04-14T11:04:07.335Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.InterfaceDetails to dao for create 2021-04-14T11:04:07.496Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VirtualLinkMonitoringParameter to dao for create 2021-04-14T11:04:07.723Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfcMonitoringParameter to dao for create 2021-04-14T11:04:07.918Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfChangeExtConnectivityOperationConfiguration to dao for create 2021-04-14T11:04:07.937Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:04:07.937Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:04:07.937Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:04:07.937Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2c288414-4005-4d8a-8dfe-ae50dfcbcf06 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:04:08.035Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send DATA_TYPE : tosca.datatypes.nfv.VnfMonitoringParameter to dao for create 2021-04-14T11:04:08.622Z [qtp580718781-19] WARN o.o.s.b.c.impl.DataTypeImportManager RequestID=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Creating data type tosca.datatypes.nfv.VnfChangeCurrentPackageOperationConfiguration which derived from abstract data type with no properties 2021-04-14T11:04:08.623Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfChangeCurrentPackageOperationConfiguration to dao for create 2021-04-14T11:04:08.631Z [qtp580718781-19] WARN o.o.s.b.c.impl.DataTypeImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 Creating data type tosca.datatypes.nfv.VnfCreateSnapshotOperationConfiguration which derived from abstract data type with no properties 2021-04-14T11:04:08.632Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfCreateSnapshotOperationConfiguration to dao for create 2021-04-14T11:04:08.714Z [qtp580718781-19] WARN o.o.s.b.c.impl.DataTypeImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 Creating data type tosca.datatypes.nfv.VnfRevertToSnapshotOperationConfiguration which derived from abstract data type with no properties 2021-04-14T11:04:08.716Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfRevertToSnapshotOperationConfiguration to dao for create 2021-04-14T11:04:08.842Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfLcmOperationsConfiguration to dao for create 2021-04-14T11:04:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c86319f-447b-484d-8e39-622bfdc85f86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c86319f-447b-484d-8e39-622bfdc85f86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@251269e4 2021-04-14T11:04:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c86319f-447b-484d-8e39-622bfdc85f86 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c86319f-447b-484d-8e39-622bfdc85f86 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:09.558Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.CpProtocolData to dao for create 2021-04-14T11:04:09.634Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfAdditionalConfigurableProperties to dao for create 2021-04-14T11:04:09.715Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfmInterfaceInfo to dao for create 2021-04-14T11:04:09.744Z [qtp580718781-19] WARN o.o.s.b.c.impl.DataTypeImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 Creating data type tosca.datatypes.nfv.OauthServerInfo which derived from abstract data type with no properties 2021-04-14T11:04:09.745Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.OauthServerInfo to dao for create 2021-04-14T11:04:09.832Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfConfigurableProperties to dao for create 2021-04-14T11:04:10.139Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfInfoModifiableAttributesExtensions to dao for create 2021-04-14T11:04:10.318Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfInfoModifiableAttributesMetadata to dao for create 2021-04-14T11:04:10.337Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfInfoModifiableAttributes to dao for create 2021-04-14T11:04:10.443Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VirtualLinkBitrateLevel to dao for create 2021-04-14T11:04:10.635Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VnfOperationAdditionalParameters to dao for create 2021-04-14T11:04:10.737Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VirtualFileStorageData to dao for create 2021-04-14T11:04:10.839Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VirtualObjectStorageData to dao for create 2021-04-14T11:04:10.934Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.VirtualBlockStorageData to dao for create 2021-04-14T11:04:11.043Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.ChecksumData to dao for create 2021-04-14T11:04:11.236Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.SwImageData to dao for create 2021-04-14T11:04:11.565Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.NsVirtualLinkQos to dao for create 2021-04-14T11:04:11.644Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.ServiceAvailability to dao for create 2021-04-14T11:04:11.653Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.NsVlProfile to dao for create 2021-04-14T11:04:11.849Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.NsProfile to dao for create 2021-04-14T11:04:12.015Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.MciopProfile to dao for create 2021-04-14T11:04:12.039Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.BootDataVimSpecificProperties to dao for create 2021-04-14T11:04:12.137Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.KvpData to dao for create 2021-04-14T11:04:12.227Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4c86319f-447b-484d-8e39-622bfdc85f86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:04:12.227Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4c86319f-447b-484d-8e39-622bfdc85f86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:04:12.233Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.ContentOrFileData to dao for create 2021-04-14T11:04:12.335Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.BootData to dao for create 2021-04-14T11:04:12.525Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.ServicePortData to dao for create 2021-04-14T11:04:12.636Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.AdditionalServiceData to dao for create 2021-04-14T11:04:12.649Z [qtp580718781-19] WARN o.o.s.b.c.impl.DataTypeImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 Creating data type tosca.datatypes.nfv.NsOperationAdditionalParameters which derived from abstract data type with no properties 2021-04-14T11:04:12.650Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.NsOperationAdditionalParameters to dao for create 2021-04-14T11:04:12.656Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.Mask to dao for create 2021-04-14T11:04:12.750Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : tosca.datatypes.nfv.NsMonitoringParameter to dao for create 2021-04-14T11:04:12.841Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : onap.datatypes.partner.access_details to dao for create 2021-04-14T11:04:12.934Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : onap.datatypes.partner.bandwidth to dao for create 2021-04-14T11:04:13.031Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : onap.datatypes.partner.service_details to dao for create 2021-04-14T11:04:13.055Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 send DATA_TYPE : onap.datatypes.partner.sppartner_details to dao for create 2021-04-14T11:04:13.128Z [qtp580718781-19] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 all DataTypeDefinition(derivedFrom=null, constraints=null, properties=[PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=onap.datatypes.partner.sppartner_details.datatype.partner_url, type=string, required=false, defaultValue=null, description=Partner URL to access and provision the service, schema=null, password=false, name=partner_url, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=null, metadata=null), name=partner_url, constraints=null]], PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=onap.datatypes.partner.sppartner_details.datatype.auth_user, type=string, required=false, defaultValue=null, description=Authentication details to access the Service URL, schema=null, password=false, name=auth_user, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=null, metadata=null), name=auth_user, constraints=null]], PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=onap.datatypes.partner.sppartner_details.datatype.auth_password, type=string, required=false, defaultValue=null, description=Authentication details to access the Service URL, schema=null, password=false, name=auth_password, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=null, metadata=null), name=auth_password, constraints=null]], PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=onap.datatypes.partner.sppartner_details.datatype.uuid, type=string, required=false, defaultValue=null, description=UUID of the service definition defined in the partner catalog, schema=null, password=false, name=uuid, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=null, metadata=null), name=uuid, constraints=null]]]) were created successfully!!! 2021-04-14T11:04:13.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=978ad2be-9890-4188-b2b4-efc917a79334 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:13.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=978ad2be-9890-4188-b2b4-efc917a79334 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d7f3dc2 2021-04-14T11:04:13.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=978ad2be-9890-4188-b2b4-efc917a79334 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:13.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=978ad2be-9890-4188-b2b4-efc917a79334 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:04:16.222Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=978ad2be-9890-4188-b2b4-efc917a79334 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:04:16.222Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=978ad2be-9890-4188-b2b4-efc917a79334 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:04:16.558Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:04:16.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=370ee898-9fc3-4b2b-a8d7-7cf85241123b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:16.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=370ee898-9fc3-4b2b-a8d7-7cf85241123b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f68e58f 2021-04-14T11:04:16.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=370ee898-9fc3-4b2b-a8d7-7cf85241123b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:16.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=370ee898-9fc3-4b2b-a8d7-7cf85241123b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:19.910Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=370ee898-9fc3-4b2b-a8d7-7cf85241123b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:04:19.911Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=370ee898-9fc3-4b2b-a8d7-7cf85241123b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:04:20.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d7e236-5c00-4323-8685-59cf3a3d85e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:20.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d7e236-5c00-4323-8685-59cf3a3d85e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d9be4e9 2021-04-14T11:04:20.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d7e236-5c00-4323-8685-59cf3a3d85e7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:20.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d7e236-5c00-4323-8685-59cf3a3d85e7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:21.863Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0a758263-564e-464f-9074-50293eb144b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.79 StatusCode=INPROGRESS RemoteHost=10.242.70.79 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:21.862454Z InvocationID=263a89ca-dbf1-4ede-865d-447a126d42ec LogTimestamp=2021-04-14T11:04:21.862662Z Entering 2021-04-14T11:04:21.863Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0a758263-564e-464f-9074-50293eb144b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.79 StatusCode=INPROGRESS userId=null RemoteHost=10.242.70.79 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:21.862454Z InvocationID=263a89ca-dbf1-4ede-865d-447a126d42ec LogTimestamp=2021-04-14T11:04:21.862662Z localAddr=10.242.62.146 remoteAddr=10.242.70.79 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:04:21.865Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:04:21.863Z InvocationID=3303e717-0fa1-494a-845e-05672e83b865 LogTimestamp=2021-04-14T11:04:21.865330Z ResponseDesc=OK Exiting. 2021-04-14T11:04:21.865Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:04:22.147Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b7d7e236-5c00-4323-8685-59cf3a3d85e7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:04:22.147Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b7d7e236-5c00-4323-8685-59cf3a3d85e7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:04:22.558Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e3731307-065c-4fca-af29-4ed140eff04a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.79 StatusCode=INPROGRESS RemoteHost=10.242.70.79 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:22.558049Z InvocationID=64e07c66-0e79-46f1-9316-b5a72ee1ca58 LogTimestamp=2021-04-14T11:04:22.558126Z Entering 2021-04-14T11:04:22.558Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e3731307-065c-4fca-af29-4ed140eff04a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.79 StatusCode=INPROGRESS userId=null RemoteHost=10.242.70.79 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:22.558049Z InvocationID=64e07c66-0e79-46f1-9316-b5a72ee1ca58 LogTimestamp=2021-04-14T11:04:22.558126Z localAddr=10.242.62.146 remoteAddr=10.242.70.79 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:04:22.562Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/CN7MaS064Jw8yJEo will send credentials over a clear channel. 2021-04-14T11:04:22.562Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/CN7MaS064Jw8yJEo (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:22.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=961b3bf6-5f7c-4c0d-96a7-8b6b527a6202 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:22.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=961b3bf6-5f7c-4c0d-96a7-8b6b527a6202 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43d2bc57 2021-04-14T11:04:22.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=961b3bf6-5f7c-4c0d-96a7-8b6b527a6202 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:22.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=961b3bf6-5f7c-4c0d-96a7-8b6b527a6202 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:22.891Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:22.897Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "CN7MaS064Jw8yJEo" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/CN7MaS064Jw8yJEo will send credentials over a clear channel. 2021-04-14T11:04:22.897Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "CN7MaS064Jw8yJEo" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/CN7MaS064Jw8yJEo (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:24.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e846115-e2a6-4f69-aec6-93df6d38489c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:24.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e846115-e2a6-4f69-aec6-93df6d38489c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28de105f 2021-04-14T11:04:24.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e846115-e2a6-4f69-aec6-93df6d38489c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:24.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e846115-e2a6-4f69-aec6-93df6d38489c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:25.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22db9936-2088-4e44-a6b8-8762e4498ff6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:25.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22db9936-2088-4e44-a6b8-8762e4498ff6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a900501 2021-04-14T11:04:25.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22db9936-2088-4e44-a6b8-8762e4498ff6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:25.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22db9936-2088-4e44-a6b8-8762e4498ff6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:25.557Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "CN7MaS064Jw8yJEo" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:25.587Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "multicloud-k8s-id" API_KEY = "CN7MaS064Jw8yJEo" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=3028 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:22.558Z InvocationID=b49c8304-28e1-403e-b5c6-6a426e56a447 LogTimestamp=2021-04-14T11:04:25.586589Z ResponseDesc=OK Exiting. 2021-04-14T11:04:25.587Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:04:27.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c62433-ffdf-4c38-99d9-58190b504b44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:27.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c62433-ffdf-4c38-99d9-58190b504b44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7247bfb9 2021-04-14T11:04:27.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c62433-ffdf-4c38-99d9-58190b504b44 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:27.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7c62433-ffdf-4c38-99d9-58190b504b44 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:29.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8dcbcb-311b-49d8-a9af-cc09d6796ab5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:29.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8dcbcb-311b-49d8-a9af-cc09d6796ab5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@242185a2 2021-04-14T11:04:29.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8dcbcb-311b-49d8-a9af-cc09d6796ab5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:29.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8dcbcb-311b-49d8-a9af-cc09d6796ab5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:31.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3281c84b-a5c0-4afa-b855-7052d0a77523 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:31.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3281c84b-a5c0-4afa-b855-7052d0a77523 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ca53591 2021-04-14T11:04:31.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3281c84b-a5c0-4afa-b855-7052d0a77523 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:31.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3281c84b-a5c0-4afa-b855-7052d0a77523 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:04:32.763Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:04:33.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66f8340c-314c-471b-9cc9-81e46f0a6142 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:33.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66f8340c-314c-471b-9cc9-81e46f0a6142 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26479f09 2021-04-14T11:04:33.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66f8340c-314c-471b-9cc9-81e46f0a6142 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:33.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66f8340c-314c-471b-9cc9-81e46f0a6142 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:34.597Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK 2021-04-14T11:04:34.620Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3dd84256-77c1-486d-bcf2-ef9bbfa1321b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.196 StatusCode=INPROGRESS RemoteHost=10.242.135.196 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:34.619683Z InvocationID=7f31cd4d-f8c2-4623-b3ea-d2af4ef3f928 LogTimestamp=2021-04-14T11:04:34.619914Z Entering 2021-04-14T11:04:34.620Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3dd84256-77c1-486d-bcf2-ef9bbfa1321b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.196 StatusCode=INPROGRESS userId=null RemoteHost=10.242.135.196 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:34.619683Z InvocationID=7f31cd4d-f8c2-4623-b3ea-d2af4ef3f928 LogTimestamp=2021-04-14T11:04:34.619914Z localAddr=10.242.62.146 remoteAddr=10.242.135.196 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:04:34.622Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:04:34.620Z InvocationID=89f6251d-74cd-4687-8610-7a6a6c5b60a4 LogTimestamp=2021-04-14T11:04:34.621993Z ResponseDesc=OK Exiting. 2021-04-14T11:04:34.622Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:04:35.083Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c1bef3e2-737a-44da-9269-ac3456f0155d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.196 StatusCode=INPROGRESS RemoteHost=10.242.135.196 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:35.082778Z InvocationID=659a0c0d-cbc5-4092-a52c-73d6d8be12bf LogTimestamp=2021-04-14T11:04:35.082878Z Entering 2021-04-14T11:04:35.083Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c1bef3e2-737a-44da-9269-ac3456f0155d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.135.196 StatusCode=INPROGRESS userId=null RemoteHost=10.242.135.196 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:35.082778Z InvocationID=659a0c0d-cbc5-4092-a52c-73d6d8be12bf LogTimestamp=2021-04-14T11:04:35.082878Z localAddr=10.242.62.146 remoteAddr=10.242.135.196 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:04:35.090Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/U59BSAkilo7TqVxH will send credentials over a clear channel. 2021-04-14T11:04:35.090Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/U59BSAkilo7TqVxH (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:35.211Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:35.218Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "U59BSAkilo7TqVxH" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/U59BSAkilo7TqVxH will send credentials over a clear channel. 2021-04-14T11:04:35.218Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "U59BSAkilo7TqVxH" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/U59BSAkilo7TqVxH (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:35.402Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "U59BSAkilo7TqVxH" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:35.412Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "multicloud-starlingx-id" API_KEY = "U59BSAkilo7TqVxH" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=329 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:35.083Z InvocationID=d49ec9c8-5139-4a0b-82a5-6100c53dd08c LogTimestamp=2021-04-14T11:04:35.412275Z ResponseDesc=OK Exiting. 2021-04-14T11:04:35.413Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:04:36.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264072aa-3926-4ceb-9cb8-b0f191a06444 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:36.393Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264072aa-3926-4ceb-9cb8-b0f191a06444 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b2460f 2021-04-14T11:04:36.394Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264072aa-3926-4ceb-9cb8-b0f191a06444 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:36.394Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=264072aa-3926-4ceb-9cb8-b0f191a06444 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:39.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e76f7d7-ac4c-4dbf-bec7-602ee547fcc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:39.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e76f7d7-ac4c-4dbf-bec7-602ee547fcc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4196c20e 2021-04-14T11:04:39.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e76f7d7-ac4c-4dbf-bec7-602ee547fcc1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:39.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e76f7d7-ac4c-4dbf-bec7-602ee547fcc1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:42.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51627ec1-ac4c-42c2-9d5d-2382f6f64d49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:42.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51627ec1-ac4c-42c2-9d5d-2382f6f64d49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@144a6e10 2021-04-14T11:04:42.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51627ec1-ac4c-42c2-9d5d-2382f6f64d49 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:42.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51627ec1-ac4c-42c2-9d5d-2382f6f64d49 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:43.533Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=59d7dffc-e5c4-400a-a3da-b623b378987b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.143 StatusCode=INPROGRESS RemoteHost=10.242.62.143 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:43.533114Z InvocationID=4b270ab1-2a04-45bc-8d1f-c7cf8d5aebc6 LogTimestamp=2021-04-14T11:04:43.533199Z Entering 2021-04-14T11:04:43.533Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=59d7dffc-e5c4-400a-a3da-b623b378987b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.143 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.143 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:43.533114Z InvocationID=4b270ab1-2a04-45bc-8d1f-c7cf8d5aebc6 LogTimestamp=2021-04-14T11:04:43.533199Z localAddr=10.242.62.146 remoteAddr=10.242.62.143 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:04:43.536Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:04:43.533Z InvocationID=39246ba8-0ffc-4b8f-b6d6-523016e4fa1f LogTimestamp=2021-04-14T11:04:43.536438Z ResponseDesc=OK Exiting. 2021-04-14T11:04:43.537Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:04:45.347Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8be92a53-6572-48c6-8d59-264fb1c14e6b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.143 StatusCode=INPROGRESS RemoteHost=10.242.62.143 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:45.346693Z InvocationID=0661c522-e27f-4658-8b45-aaa4b9b36aa0 LogTimestamp=2021-04-14T11:04:45.346767Z Entering 2021-04-14T11:04:45.347Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8be92a53-6572-48c6-8d59-264fb1c14e6b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.143 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.143 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:45.346693Z InvocationID=0661c522-e27f-4658-8b45-aaa4b9b36aa0 LogTimestamp=2021-04-14T11:04:45.346767Z localAddr=10.242.62.146 remoteAddr=10.242.62.143 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:04:45.350Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/XJuIPvwhbYL4RGX8 will send credentials over a clear channel. 2021-04-14T11:04:45.351Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/XJuIPvwhbYL4RGX8 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:45.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66734d4b-a1eb-407a-89ce-ee8b3524761e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:45.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66734d4b-a1eb-407a-89ce-ee8b3524761e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e6f0447 2021-04-14T11:04:45.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66734d4b-a1eb-407a-89ce-ee8b3524761e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:45.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66734d4b-a1eb-407a-89ce-ee8b3524761e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:45.610Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:45.617Z [qtp580718781-11] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "XJuIPvwhbYL4RGX8" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/XJuIPvwhbYL4RGX8 will send credentials over a clear channel. 2021-04-14T11:04:45.617Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "XJuIPvwhbYL4RGX8" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/XJuIPvwhbYL4RGX8 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:04:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:04:46.563Z [qtp580718781-11] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "XJuIPvwhbYL4RGX8" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:04:46.693Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "multicloud-windriver-id" API_KEY = "XJuIPvwhbYL4RGX8" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=1345 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:04:45.347Z InvocationID=b0d22d56-5030-46cb-9e44-b020f046721f LogTimestamp=2021-04-14T11:04:46.692759Z ResponseDesc=OK Exiting. 2021-04-14T11:04:46.693Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:04:47.069Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:04:47.098Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=48275 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/datatypes TargetServiceName=null EntryTimestamp=2021-04-14T11:03:58.823Z InvocationID=13e910d8-33e6-46f7-8b83-1d986dc90040 ErrorCode=500 LogTimestamp=2021-04-14T11:04:47.098552Z ResponseDesc=Created Exiting. 2021-04-14T11:04:47.099Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/datatypes HTTP/1.1 SC="201" 2021-04-14T11:04:47.321Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=11562678-8589-4838-9cd4-a43683bbd975 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/capability ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:47.321004Z InvocationID=4b808549-6795-4fd4-86f6-2b4e158e2933 LogTimestamp=2021-04-14T11:04:47.321099Z Entering 2021-04-14T11:04:47.321Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=11562678-8589-4838-9cd4-a43683bbd975 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/capability ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:47.321004Z InvocationID=4b808549-6795-4fd4-86f6-2b4e158e2933 LogTimestamp=2021-04-14T11:04:47.321099Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/capability HTTP/1.1 2021-04-14T11:04:47.347Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Root to dao for create 2021-04-14T11:04:48.032Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Attachment to dao for create 2021-04-14T11:04:48.331Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Node to dao for create 2021-04-14T11:04:48.413Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Container to dao for create 2021-04-14T11:04:48.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457c034f-2a24-42c1-a7c5-d92074122cfa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:48.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457c034f-2a24-42c1-a7c5-d92074122cfa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7596a9bb 2021-04-14T11:04:48.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457c034f-2a24-42c1-a7c5-d92074122cfa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:48.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457c034f-2a24-42c1-a7c5-d92074122cfa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:48.736Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.PortMirroring to dao for create 2021-04-14T11:04:48.933Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Endpoint to dao for create 2021-04-14T11:04:49.842Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.DatabaseEndpoint to dao for create 2021-04-14T11:04:49.936Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Endpoint.Public to dao for create 2021-04-14T11:04:49.966Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Endpoint.Admin to dao for create 2021-04-14T11:04:50.036Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Endpoint.Database to dao for create 2021-04-14T11:04:50.044Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.OperatingSystem to dao for create 2021-04-14T11:04:50.234Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Scalable to dao for create 2021-04-14T11:04:50.332Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.network.Bindable to dao for create 2021-04-14T11:04:50.337Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.Container.Docker to dao for create 2021-04-14T11:04:50.550Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.network.Linkable to dao for create 2021-04-14T11:04:50.634Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.AllottedResource to dao for create 2021-04-14T11:04:50.714Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.Metric to dao for create 2021-04-14T11:04:50.722Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.Metric to dao for create 2021-04-14T11:04:50.823Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.metric.Ceilometer to dao for create 2021-04-14T11:04:50.843Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.metric.SnmpPolling to dao for create 2021-04-14T11:04:50.935Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.metric.SnmpTrap to dao for create 2021-04-14T11:04:50.946Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.Forwarder to dao for create 2021-04-14T11:04:51.033Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.VLANAssignment to dao for create 2021-04-14T11:04:51.042Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.RoutingConfiguration to dao for create 2021-04-14T11:04:51.133Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : org.openecomp.capabilities.FabricConfiguration to dao for create 2021-04-14T11:04:51.138Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.VirtualStorage to dao for create 2021-04-14T11:04:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f601830-2f70-472d-b909-02e508557851 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f601830-2f70-472d-b909-02e508557851 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26783b5 2021-04-14T11:04:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f601830-2f70-472d-b909-02e508557851 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:51.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f601830-2f70-472d-b909-02e508557851 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:51.232Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.VirtualCompute to dao for create 2021-04-14T11:04:51.419Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.VirtualBindable to dao for create 2021-04-14T11:04:51.431Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.VirtualLinkable to dao for create 2021-04-14T11:04:51.435Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.ExtVirtualLinkable to dao for create 2021-04-14T11:04:51.533Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.Forwarder to dao for create 2021-04-14T11:04:51.538Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.ext.GuestOs to dao for create 2021-04-14T11:04:51.544Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.ext.ImageFile to dao for create 2021-04-14T11:04:51.631Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.ext.LocalAttachment to dao for create 2021-04-14T11:04:51.635Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.ext.Compute.Container.Architecture to dao for create 2021-04-14T11:04:51.717Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send CAPABILITY_TYPE : tosca.capabilities.nfv.Forwarding to dao for create 2021-04-14T11:04:51.721Z [qtp580718781-16] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m all CapabilityTypeDefinition(super=CapabilityTypeDataDefinition [uniqueId=tosca.capabilities.nfv.Forwarding, description=null, type=tosca.capabilities.nfv.Forwarding, validSourceTypes=null, version=null, creationTime=1618398291719, modificationTime=1618398291719], derivedFrom=tosca.capabilities.Root, properties=null) were created successfully!!! 2021-04-14T11:04:54.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feac21af-84fe-4ef2-9047-121c2e20bb86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:54.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feac21af-84fe-4ef2-9047-121c2e20bb86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@451a4707 2021-04-14T11:04:54.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feac21af-84fe-4ef2-9047-121c2e20bb86 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:54.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feac21af-84fe-4ef2-9047-121c2e20bb86 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:55.523Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=8202 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/capability EntryTimestamp=2021-04-14T11:04:47.321Z InvocationID=685895c6-9f7f-497b-a0a1-2ef13bfa58c0 LogTimestamp=2021-04-14T11:04:55.523724Z ResponseDesc=Created Exiting. 2021-04-14T11:04:55.524Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/capability HTTP/1.1 SC="201" 2021-04-14T11:04:55.692Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3c514ee2-6c5b-46d7-a286-06f379f2b5c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/relationship ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:55.691583Z InvocationID=6689acb1-bc9e-4f40-bf21-e9930fcc5170 LogTimestamp=2021-04-14T11:04:55.691697Z Entering 2021-04-14T11:04:55.692Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3c514ee2-6c5b-46d7-a286-06f379f2b5c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/relationship ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:04:55.691583Z InvocationID=6689acb1-bc9e-4f40-bf21-e9930fcc5170 LogTimestamp=2021-04-14T11:04:55.691697Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/relationship HTTP/1.1 2021-04-14T11:04:55.714Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.Root to dao for create 2021-04-14T11:04:56.289Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.ConnectsTo to dao for create 2021-04-14T11:04:56.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab982f4f-f82e-43fc-844e-f14437a5f265 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:56.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab982f4f-f82e-43fc-844e-f14437a5f265 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33a12edf 2021-04-14T11:04:56.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab982f4f-f82e-43fc-844e-f14437a5f265 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:56.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab982f4f-f82e-43fc-844e-f14437a5f265 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:56.907Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.RoutesTo to dao for create 2021-04-14T11:04:57.517Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.AttachesTo to dao for create 2021-04-14T11:04:58.207Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.HostedOn to dao for create 2021-04-14T11:04:58.801Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.DependsOn to dao for create 2021-04-14T11:04:59.400Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.network.LinksTo to dao for create 2021-04-14T11:04:59.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71c40daf-fb04-4963-bd7e-a9479ffb0c07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:04:59.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71c40daf-fb04-4963-bd7e-a9479ffb0c07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@733a8261 2021-04-14T11:04:59.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71c40daf-fb04-4963-bd7e-a9479ffb0c07 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:04:59.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71c40daf-fb04-4963-bd7e-a9479ffb0c07 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:04:59.943Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.network.BindsTo to dao for create 2021-04-14T11:05:00.470Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : org.openecomp.relationships.AttachesTo to dao for create 2021-04-14T11:05:01.037Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : org.openecomp.relationships.VolumeAttachesTo to dao for create 2021-04-14T11:05:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:05:01.204Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:05:01.619Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : org.openecomp.relationships.ForwardsTo to dao for create 2021-04-14T11:05:02.146Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : org.openecomp.relationships.AssignsTo to dao for create 2021-04-14T11:05:02.733Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : org.openecomp.relationships.RoutesTo to dao for create 2021-04-14T11:05:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b288992-935c-4b9f-a938-a2a5af655b13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b288992-935c-4b9f-a938-a2a5af655b13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dfedd98 2021-04-14T11:05:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b288992-935c-4b9f-a938-a2a5af655b13 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b288992-935c-4b9f-a938-a2a5af655b13 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:03.342Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.nfv.VirtualBindsTo to dao for create 2021-04-14T11:05:03.940Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.nfv.VirtualLinksTo to dao for create 2021-04-14T11:05:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:05:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:05:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:04.630Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.nfv.AttachesTo to dao for create 2021-04-14T11:05:05.235Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.nfv.Vdu.AttachedTo to dao for create 2021-04-14T11:05:06.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c7de22a-2201-46bd-9a3c-e1d554549121 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:06.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c7de22a-2201-46bd-9a3c-e1d554549121 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5acb995f 2021-04-14T11:05:06.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c7de22a-2201-46bd-9a3c-e1d554549121 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:06.191Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c7de22a-2201-46bd-9a3c-e1d554549121 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:06.882Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.nfv.ForwardTo to dao for create 2021-04-14T11:05:07.884Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send RELATIONSHIP_TYPE : tosca.relationships.nfv.ContainerBindsTo to dao for create 2021-04-14T11:05:09.113Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m all RelationshipTypeDataDefinition [uniqueId=tosca.relationships.nfv.ContainerBindsTo, description=Represents an association relationship between Vdu.OsContainerGroup and VduCp node types, type=tosca.relationships.nfv.ContainerBindsTo, validSourceTypes=null, version=null, originUI=null, creationTime=1618398307886, modificationTime=1618398307886] [ derivedFrom=tosca.relationships.DependsOn, properties=null ] were created successfully!!! 2021-04-14T11:05:09.155Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=13462 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/relationship EntryTimestamp=2021-04-14T11:04:55.692Z InvocationID=491b970b-e7b1-4a8f-9785-44582eff732f LogTimestamp=2021-04-14T11:05:09.154832Z ResponseDesc=Created Exiting. 2021-04-14T11:05:09.155Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/relationship HTTP/1.1 SC="201" 2021-04-14T11:05:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4d1c65e-9271-4d9c-816d-f17fa736ad57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4d1c65e-9271-4d9c-816d-f17fa736ad57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6026830f 2021-04-14T11:05:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4d1c65e-9271-4d9c-816d-f17fa736ad57 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4d1c65e-9271-4d9c-816d-f17fa736ad57 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:09.318Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7be2f449-f52c-4665-9522-908ee7f4f0f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/interfaceLifecycle ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:09.318652Z InvocationID=b7bb39e0-dc9e-4e07-babe-43b07f54c896 LogTimestamp=2021-04-14T11:05:09.318716Z Entering 2021-04-14T11:05:09.319Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7be2f449-f52c-4665-9522-908ee7f4f0f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/uploadType/interfaceLifecycle ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:09.318652Z InvocationID=b7bb39e0-dc9e-4e07-babe-43b07f54c896 LogTimestamp=2021-04-14T11:05:09.318716Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/interfaceLifecycle HTTP/1.1 2021-04-14T11:05:09.333Z [qtp580718781-11] INFO o.o.s.b.c.i.InterfaceLifecycleTypeImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send interfaceDefinition tosca.interfaces.Root to dao for create 2021-04-14T11:05:10.111Z [qtp580718781-11] INFO o.o.s.b.c.i.InterfaceLifecycleTypeImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send interfaceDefinition tosca.interfaces.nfv.vnf.lifecycle.Nfv to dao for create 2021-04-14T11:05:12.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cacf17c2-a535-48b4-afd7-cd7c7bd7ed50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:12.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cacf17c2-a535-48b4-afd7-cd7c7bd7ed50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47a83ce0 2021-04-14T11:05:12.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cacf17c2-a535-48b4-afd7-cd7c7bd7ed50 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:12.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cacf17c2-a535-48b4-afd7-cd7c7bd7ed50 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:13.119Z [qtp580718781-11] INFO o.o.s.b.c.i.InterfaceLifecycleTypeImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send interfaceDefinition tosca.interfaces.node.lifecycle.Standard to dao for create 2021-04-14T11:05:13.918Z [qtp580718781-11] INFO o.o.s.b.c.i.InterfaceLifecycleTypeImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send interfaceDefinition tosca.interfaces.relationship.Configure to dao for create 2021-04-14T11:05:15.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac924e6d-4fb0-46e4-94ce-9a818c5c9f5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:15.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac924e6d-4fb0-46e4-94ce-9a818c5c9f5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c813b90 2021-04-14T11:05:15.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac924e6d-4fb0-46e4-94ce-9a818c5c9f5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:15.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac924e6d-4fb0-46e4-94ce-9a818c5c9f5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:15.412Z [qtp580718781-11] INFO o.o.s.b.c.i.InterfaceLifecycleTypeImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send interfaceDefinition tosca.interfaces.nfv.Vnflcm to dao for create 2021-04-14T11:05:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:05:16.791Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:05:17.203Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4afb8d47-61b7-4ee9-94b1-48daab1ebbeb InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=sdnc ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.175 StatusCode=INPROGRESS RemoteHost=10.242.228.175 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:17.202721Z InvocationID=a839dae7-c97f-45b9-8359-ea952315a780 LogTimestamp=2021-04-14T11:05:17.202811Z Entering 2021-04-14T11:05:17.203Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4afb8d47-61b7-4ee9-94b1-48daab1ebbeb InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=sdnc ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.175 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.175 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:17.202721Z InvocationID=a839dae7-c97f-45b9-8359-ea952315a780 LogTimestamp=2021-04-14T11:05:17.202811Z localAddr=10.242.62.146 remoteAddr=10.242.228.175 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:05:17.206Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:05:17.203Z InvocationID=6cd308e7-afbf-43fe-9ada-27ba07bfc375 LogTimestamp=2021-04-14T11:05:17.205945Z ResponseDesc=OK Exiting. 2021-04-14T11:05:17.206Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:05:17.443Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=86c2c4b8-5695-497f-bc4d-78c0167f3ffb InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=sdnc ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.175 StatusCode=INPROGRESS RemoteHost=10.242.228.175 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:17.443336Z InvocationID=6468c729-c7fa-46e5-99ed-82cf091ddfc8 LogTimestamp=2021-04-14T11:05:17.443395Z Entering 2021-04-14T11:05:17.443Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=86c2c4b8-5695-497f-bc4d-78c0167f3ffb InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=sdnc ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.175 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.175 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:17.443336Z InvocationID=6468c729-c7fa-46e5-99ed-82cf091ddfc8 LogTimestamp=2021-04-14T11:05:17.443395Z localAddr=10.242.62.146 remoteAddr=10.242.228.175 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:05:17.447Z [qtp580718781-18] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/vFL08iTU5XVA9H3S will send credentials over a clear channel. 2021-04-14T11:05:17.447Z [qtp580718781-18] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/vFL08iTU5XVA9H3S (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:17.488Z [qtp580718781-18] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:05:17.495Z [qtp580718781-18] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "vFL08iTU5XVA9H3S" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/vFL08iTU5XVA9H3S will send credentials over a clear channel. 2021-04-14T11:05:17.495Z [qtp580718781-18] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "vFL08iTU5XVA9H3S" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/vFL08iTU5XVA9H3S (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:17.524Z [qtp580718781-18] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "vFL08iTU5XVA9H3S" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:05:17.585Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "sdc-COpenSource-Env11-sdnc-dockero" API_KEY = "vFL08iTU5XVA9H3S" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=141 PartnerName=Apache-HttpClient/4.5.10 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:17.443Z InvocationID=daf45f75-7e59-4f62-9809-4c6b5337a4a6 LogTimestamp=2021-04-14T11:05:17.584817Z ResponseDesc=OK Exiting. 2021-04-14T11:05:17.590Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:05:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0478e14d-61bc-40e1-bd54-22d6f241c308 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0478e14d-61bc-40e1-bd54-22d6f241c308 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a06543e 2021-04-14T11:05:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0478e14d-61bc-40e1-bd54-22d6f241c308 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0478e14d-61bc-40e1-bd54-22d6f241c308 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:18.113Z [qtp580718781-11] INFO o.o.s.b.c.i.InterfaceLifecycleTypeImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lifecycle types were created successfully!!! 2021-04-14T11:05:18.137Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=8818 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/interfaceLifecycle EntryTimestamp=2021-04-14T11:05:09.319Z InvocationID=d070179e-9b0f-4b8c-b67d-e410c093caec LogTimestamp=2021-04-14T11:05:18.137377Z ResponseDesc=Created Exiting. 2021-04-14T11:05:18.138Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/interfaceLifecycle HTTP/1.1 SC="201" 2021-04-14T11:05:18.156Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8cd09e3c-c43f-4807-8a70-30fa1a8802fd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/uploadType/categories ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:18.155806Z InvocationID=8bd55273-f4e4-47e2-bc37-e1b7a9b0582b LogTimestamp=2021-04-14T11:05:18.155897Z Entering 2021-04-14T11:05:18.156Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8cd09e3c-c43f-4807-8a70-30fa1a8802fd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/uploadType/categories ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:18.155806Z InvocationID=8bd55273-f4e4-47e2-bc37-e1b7a9b0582b LogTimestamp=2021-04-14T11:05:18.155897Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/categories HTTP/1.1 2021-04-14T11:05:19.429Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK 2021-04-14T11:05:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59747194-6f9c-463c-bf4c-aa69c4f26d8d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59747194-6f9c-463c-bf4c-aa69c4f26d8d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2eec8e8a 2021-04-14T11:05:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59747194-6f9c-463c-bf4c-aa69c4f26d8d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:20.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59747194-6f9c-463c-bf4c-aa69c4f26d8d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:20.623Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL ErrorCategory=INFO RequestID=null ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Internal flow error. Operation: Succeed to replace the data types cache 2021-04-14T11:05:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c53408c-b2cd-4128-8d15-4a943d2c7f74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c53408c-b2cd-4128-8d15-4a943d2c7f74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28a5f88b 2021-04-14T11:05:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c53408c-b2cd-4128-8d15-4a943d2c7f74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c53408c-b2cd-4128-8d15-4a943d2c7f74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806b7715-c3a5-40d7-8535-419930ab4b68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806b7715-c3a5-40d7-8535-419930ab4b68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d8d1bb4 2021-04-14T11:05:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806b7715-c3a5-40d7-8535-419930ab4b68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806b7715-c3a5-40d7-8535-419930ab4b68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:30.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0accc6e-f765-4a61-bec7-81138e52e11e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:30.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0accc6e-f765-4a61-bec7-81138e52e11e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15e2139f 2021-04-14T11:05:30.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0accc6e-f765-4a61-bec7-81138e52e11e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:30.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0accc6e-f765-4a61-bec7-81138e52e11e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:05:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:05:33.130Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4f92a28e-3887-4e3d-9b99-1dc56112ef36 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=cds ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.134 StatusCode=INPROGRESS RemoteHost=10.242.228.134 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:33.130173Z InvocationID=3fc3e1c4-76b6-4710-bcd4-3541378d36e2 LogTimestamp=2021-04-14T11:05:33.130359Z Entering 2021-04-14T11:05:33.130Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4f92a28e-3887-4e3d-9b99-1dc56112ef36 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=cds ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.134 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.134 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:33.130173Z InvocationID=3fc3e1c4-76b6-4710-bcd4-3541378d36e2 LogTimestamp=2021-04-14T11:05:33.130359Z localAddr=10.242.62.146 remoteAddr=10.242.228.134 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:05:33.133Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:05:33.131Z InvocationID=21e74cef-f89a-48b1-b5f6-04a272299212 LogTimestamp=2021-04-14T11:05:33.132872Z ResponseDesc=OK Exiting. 2021-04-14T11:05:33.133Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:05:33.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97a796db-1541-4985-aead-26e48f17a6dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:33.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97a796db-1541-4985-aead-26e48f17a6dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f304777 2021-04-14T11:05:33.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97a796db-1541-4985-aead-26e48f17a6dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:33.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97a796db-1541-4985-aead-26e48f17a6dd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:33.232Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5373358a-0c4f-45be-84c8-284f76c6b8ba InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=cds ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.134 StatusCode=INPROGRESS RemoteHost=10.242.228.134 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:33.232141Z InvocationID=d866c7f1-2b0d-41c4-b31e-02ac2353ff77 LogTimestamp=2021-04-14T11:05:33.232320Z Entering 2021-04-14T11:05:33.232Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5373358a-0c4f-45be-84c8-284f76c6b8ba InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=cds ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.134 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.134 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:33.232141Z InvocationID=d866c7f1-2b0d-41c4-b31e-02ac2353ff77 LogTimestamp=2021-04-14T11:05:33.232320Z localAddr=10.242.62.146 remoteAddr=10.242.228.134 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:05:33.236Z [qtp580718781-17] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/C5MrIs6pGJrKFJUL will send credentials over a clear channel. 2021-04-14T11:05:33.236Z [qtp580718781-17] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/C5MrIs6pGJrKFJUL (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:33.264Z [qtp580718781-17] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:05:33.313Z [qtp580718781-17] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "C5MrIs6pGJrKFJUL" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/C5MrIs6pGJrKFJUL will send credentials over a clear channel. 2021-04-14T11:05:33.313Z [qtp580718781-17] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "C5MrIs6pGJrKFJUL" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/C5MrIs6pGJrKFJUL (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:33.337Z [qtp580718781-17] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "C5MrIs6pGJrKFJUL" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:05:33.421Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "cds" API_KEY = "C5MrIs6pGJrKFJUL" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=189 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:33.232Z InvocationID=ad61b354-de09-477f-acfa-b5f4e5584423 LogTimestamp=2021-04-14T11:05:33.421017Z ResponseDesc=OK Exiting. 2021-04-14T11:05:33.421Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:05:35.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=762d4561-e7fa-4d48-bb42-fde07929fbbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:35.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=762d4561-e7fa-4d48-bb42-fde07929fbbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58569dba 2021-04-14T11:05:35.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=762d4561-e7fa-4d48-bb42-fde07929fbbb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:35.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=762d4561-e7fa-4d48-bb42-fde07929fbbb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:38.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a2b0484-db3f-4212-b4e3-073b49174add PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:38.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a2b0484-db3f-4212-b4e3-073b49174add PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d336dbf 2021-04-14T11:05:38.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a2b0484-db3f-4212-b4e3-073b49174add PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:38.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a2b0484-db3f-4212-b4e3-073b49174add PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:40.569Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9f4a6b74-5711-413b-b3f5-0f78650053ce InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:40.569380Z InvocationID=049cee61-b688-4fd6-ab22-c75d594ed7d2 LogTimestamp=2021-04-14T11:05:40.569601Z Entering 2021-04-14T11:05:40.570Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9f4a6b74-5711-413b-b3f5-0f78650053ce InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:40.569380Z InvocationID=049cee61-b688-4fd6-ab22-c75d594ed7d2 LogTimestamp=2021-04-14T11:05:40.569601Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:05:40.572Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:05:40.570Z InvocationID=13e53efc-e2c0-4742-ae97-137af6fb8eb4 LogTimestamp=2021-04-14T11:05:40.572018Z ResponseDesc=OK Exiting. 2021-04-14T11:05:40.572Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:05:40.734Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=57cb7511-9057-4d04-94b9-9d16e6abb7a2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:40.734337Z InvocationID=ff2ffa2e-dbdb-4982-9d95-92aa2207f577 LogTimestamp=2021-04-14T11:05:40.734429Z Entering 2021-04-14T11:05:40.734Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=57cb7511-9057-4d04-94b9-9d16e6abb7a2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:40.734337Z InvocationID=ff2ffa2e-dbdb-4982-9d95-92aa2207f577 LogTimestamp=2021-04-14T11:05:40.734429Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:05:40.740Z [qtp580718781-19] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/OKVCGen2OI8w7e9B will send credentials over a clear channel. 2021-04-14T11:05:40.740Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/OKVCGen2OI8w7e9B (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:40.769Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:05:40.774Z [qtp580718781-19] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "OKVCGen2OI8w7e9B" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/OKVCGen2OI8w7e9B will send credentials over a clear channel. 2021-04-14T11:05:40.774Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "OKVCGen2OI8w7e9B" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/OKVCGen2OI8w7e9B (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:05:40.794Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "OKVCGen2OI8w7e9B" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:05:40.799Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "ves-openapi-manager" API_KEY = "OKVCGen2OI8w7e9B" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=63 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:05:40.735Z InvocationID=93047698-0bf6-4c63-87ec-d01eb2555f09 LogTimestamp=2021-04-14T11:05:40.798915Z ResponseDesc=OK Exiting. 2021-04-14T11:05:40.799Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:05:41.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4452a382-29b2-44aa-97a9-46fc495eb6a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:41.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4452a382-29b2-44aa-97a9-46fc495eb6a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68c8e56d 2021-04-14T11:05:41.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4452a382-29b2-44aa-97a9-46fc495eb6a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:41.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4452a382-29b2-44aa-97a9-46fc495eb6a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34703216-bf61-459f-9d48-1edb83dd03b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34703216-bf61-459f-9d48-1edb83dd03b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@359e1cfc 2021-04-14T11:05:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34703216-bf61-459f-9d48-1edb83dd03b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34703216-bf61-459f-9d48-1edb83dd03b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:05:46.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:05:48.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc96604f-4766-4ec8-9a0e-ce7d637237c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:48.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc96604f-4766-4ec8-9a0e-ce7d637237c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5949ecb8 2021-04-14T11:05:48.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc96604f-4766-4ec8-9a0e-ce7d637237c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:48.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc96604f-4766-4ec8-9a0e-ce7d637237c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc906d4-fda3-4e87-b35a-8df1457bdc6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc906d4-fda3-4e87-b35a-8df1457bdc6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f612cbb 2021-04-14T11:05:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc906d4-fda3-4e87-b35a-8df1457bdc6f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc906d4-fda3-4e87-b35a-8df1457bdc6f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:54.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a092546-5fc0-458a-9560-efd050ac3799 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:54.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a092546-5fc0-458a-9560-efd050ac3799 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ad47b7 2021-04-14T11:05:54.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a092546-5fc0-458a-9560-efd050ac3799 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:54.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a092546-5fc0-458a-9560-efd050ac3799 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:55.825Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=37668 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/categories EntryTimestamp=2021-04-14T11:05:18.156Z InvocationID=630dbe81-ac54-4f33-871f-e3116d6b8405 LogTimestamp=2021-04-14T11:05:55.824839Z ResponseDesc=Created Exiting. 2021-04-14T11:05:55.825Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/categories HTTP/1.1 SC="201" 2021-04-14T11:05:55.891Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8abd46c6-391a-4b33-b314-65a6691f8e3f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:55.890869Z InvocationID=5d2e8d93-06e8-41aa-aa12-f66cd4145c42 LogTimestamp=2021-04-14T11:05:55.890951Z Entering 2021-04-14T11:05:55.891Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8abd46c6-391a-4b33-b314-65a6691f8e3f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:05:55.890869Z InvocationID=5d2e8d93-06e8-41aa-aa12-f66cd4145c42 LogTimestamp=2021-04-14T11:05:55.890951Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:05:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=132acbd7-21fd-4159-bec5-06683b9417dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=132acbd7-21fd-4159-bec5-06683b9417dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4511c2a2 2021-04-14T11:05:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=132acbd7-21fd-4159-bec5-06683b9417dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=132acbd7-21fd-4159-bec5-06683b9417dd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:05:57.297Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:05:57.297Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:05:57.297Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:05:57.298Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:05:57.490Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Root 2021-04-14T11:05:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af56836-4af0-4ea5-9f2f-f11d90100f85 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:05:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af56836-4af0-4ea5-9f2f-f11d90100f85 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@532bda94 2021-04-14T11:05:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af56836-4af0-4ea5-9f2f-f11d90100f85 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:05:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af56836-4af0-4ea5-9f2f-f11d90100f85 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:00.755Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Root" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cce32116-3a02-4416-be47-c76ba21b85a3" INVARIANT_UUID = "2c225cf8-52b6-4570-902d-aea1f1663c6a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Root" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cce32116-3a02-4416-be47-c76ba21b85a3 EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id d1f26bd1-b001-4080-9ff5-02ad50e4609d 2021-04-14T11:06:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:06:01.211Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:06:03.145Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Root" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cce32116-3a02-4416-be47-c76ba21b85a3" INVARIANT_UUID = "2c225cf8-52b6-4570-902d-aea1f1663c6a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d1f26bd1-b001-4080-9ff5-02ad50e4609d.assettoscatemplate" CURR_ARTIFACT_UUID = "d1f26bd1-b001-4080-9ff5-02ad50e4609d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Root-template.yml,0,d1f26bd1-b001-4080-9ff5-02ad50e4609d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=7253 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=16556334-1efc-4dac-95f8-c33cdd9be803 EntryTimestamp=2021-04-14T11:05:55.892Z InvocationID=d4326932-3cb3-4af0-93a6-c1abf70d14a6 LogTimestamp=2021-04-14T11:06:03.145401Z ResponseDesc=Created Exiting. 2021-04-14T11:06:03.146Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:03.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e102f80-b385-4725-9881-8a0c5fe43e51 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:03.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e102f80-b385-4725-9881-8a0c5fe43e51 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@750930be 2021-04-14T11:06:03.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e102f80-b385-4725-9881-8a0c5fe43e51 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:03.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e102f80-b385-4725-9881-8a0c5fe43e51 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:03.220Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cc144dcc-547c-489e-99b6-dccdb4969806 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:03.220669Z InvocationID=4c40cc81-6f04-4ad5-968b-e4ac418eddb3 LogTimestamp=2021-04-14T11:06:03.220722Z Entering 2021-04-14T11:06:03.221Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cc144dcc-547c-489e-99b6-dccdb4969806 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:03.220669Z InvocationID=4c40cc81-6f04-4ad5-968b-e4ac418eddb3 LogTimestamp=2021-04-14T11:06:03.220722Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:06:04.350Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:06:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:06:05.032Z [ComponentsCleanThread-1] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null lock resource with name DELETE_LOCKER 2021-04-14T11:06:05.235Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:05.236Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:05.236Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:05.236Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:05.911Z [ComponentsCleanThread-1] INFO o.o.s.b.c.s.ComponentsCleanBusinessLogic RequestID=null Lock cleanup operation is done with result = OK 2021-04-14T11:06:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb133865-6820-48c1-b8b2-ee83445ec735 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb133865-6820-48c1-b8b2-ee83445ec735 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ff34157 2021-04-14T11:06:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb133865-6820-48c1-b8b2-ee83445ec735 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb133865-6820-48c1-b8b2-ee83445ec735 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:07.510Z [ComponentsCleanThread-1] INFO o.o.s.b.c.s.ComponentsCleanBusinessLogic RequestID=null Unlock cleanup operation is done with result = OK 2021-04-14T11:06:08.134Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Compute 2021-04-14T11:06:09.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cc4c31-831b-49c5-8344-5f9af2d73711 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:09.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cc4c31-831b-49c5-8344-5f9af2d73711 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54bc84d9 2021-04-14T11:06:09.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cc4c31-831b-49c5-8344-5f9af2d73711 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:09.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cc4c31-831b-49c5-8344-5f9af2d73711 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:12.131Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Compute" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b91ee4c2-cca8-4db2-bf49-c753b6fabba6 EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:06:12.132Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b91ee4c2-cca8-4db2-bf49-c753b6fabba6 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:06:12.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45291d0-8610-47e6-b5f9-ab1b3f70ad54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:12.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45291d0-8610-47e6-b5f9-ab1b3f70ad54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59ce1ba0 2021-04-14T11:06:12.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45291d0-8610-47e6-b5f9-ab1b3f70ad54 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:12.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45291d0-8610-47e6-b5f9-ab1b3f70ad54 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:13.450Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b91ee4c2-cca8-4db2-bf49-c753b6fabba6 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 ErrorCode=500 lock resource with id c1fdfb7e-1426-4eb2-bb39-de5430865aa4 2021-04-14T11:06:14.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b37b193f-3f9a-4e86-96ed-4fde751af5e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:14.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b37b193f-3f9a-4e86-96ed-4fde751af5e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65fe5ce7 2021-04-14T11:06:14.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b37b193f-3f9a-4e86-96ed-4fde751af5e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:14.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b37b193f-3f9a-4e86-96ed-4fde751af5e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:15.496Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate" CURR_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Compute-template.yml,0,c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a57b0a0-c3f5-475a-ba89-073f66b8ab5b TargetServiceName=null EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 ErrorCode=500 Starting to create Csar for component Compute 2021-04-14T11:06:15.912Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate" CURR_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Compute-template.yml,0,c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a57b0a0-c3f5-475a-ba89-073f66b8ab5b TargetServiceName=null EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 ErrorCode=500 Ended create Csar for component Compute 2021-04-14T11:06:15.915Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate" CURR_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Compute-template.yml,0,c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a57b0a0-c3f5-475a-ba89-073f66b8ab5b TargetServiceName=null EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 ErrorCode=500 lock resource with id c1fdfb7e-1426-4eb2-bb39-de5430865aa4 2021-04-14T11:06:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:06:16.231Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:06:17.831Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "b91ee4c2-cca8-4db2-bf49-c753b6fabba6" INVARIANT_UUID = "f80ae539-18ef-4840-a8a5-14e30ba823d2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscacsar" CURR_ARTIFACT_UUID = "c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Compute-csar.csar,0,c1fdfb7e-1426-4eb2-bb39-de5430865aa4.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14609 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d9af4d78-2a21-4887-b08c-5ccc4e990c3a TargetServiceName=null EntryTimestamp=2021-04-14T11:06:03.221Z InvocationID=1501a9e2-3fdb-4b21-a45d-fe7c0896ac36 ErrorCode=500 LogTimestamp=2021-04-14T11:06:17.830754Z ResponseDesc=Created Exiting. 2021-04-14T11:06:17.831Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:17.894Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b7dabe23-c3f8-41db-b176-e1d443468f95 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:17.894186Z InvocationID=89cbde7b-ce47-421a-9ae6-f978f43ef162 LogTimestamp=2021-04-14T11:06:17.894292Z Entering 2021-04-14T11:06:17.894Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b7dabe23-c3f8-41db-b176-e1d443468f95 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:17.894186Z InvocationID=89cbde7b-ce47-421a-9ae6-f978f43ef162 LogTimestamp=2021-04-14T11:06:17.894292Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d552401-e4bb-4b3a-b6bb-ffcfd4d5d082 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d552401-e4bb-4b3a-b6bb-ffcfd4d5d082 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@600240f6 2021-04-14T11:06:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d552401-e4bb-4b3a-b6bb-ffcfd4d5d082 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:17.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d552401-e4bb-4b3a-b6bb-ffcfd4d5d082 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:19.014Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:19.014Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:19.014Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:19.014Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:19.100Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Softwarecomponent 2021-04-14T11:06:19.720Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK 2021-04-14T11:06:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3226f4bb-7656-411a-8874-38dc92e3a6f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3226f4bb-7656-411a-8874-38dc92e3a6f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50a88a63 2021-04-14T11:06:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3226f4bb-7656-411a-8874-38dc92e3a6f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3226f4bb-7656-411a-8874-38dc92e3a6f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:21.099Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "SoftwareComponent" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "685547f1-c5a1-4068-a10d-053c1f992ba9" INVARIANT_UUID = "d5d5be9a-1190-4cce-82fd-e374dcbd503c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.SoftwareComponent" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=685547f1-c5a1-4068-a10d-053c1f992ba9 EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id c563a8fe-0035-4705-886c-18e220790f77 2021-04-14T11:06:22.743Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "SoftwareComponent" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "685547f1-c5a1-4068-a10d-053c1f992ba9" INVARIANT_UUID = "d5d5be9a-1190-4cce-82fd-e374dcbd503c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c563a8fe-0035-4705-886c-18e220790f77.assettoscatemplate" CURR_ARTIFACT_UUID = "c563a8fe-0035-4705-886c-18e220790f77.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Softwarecomponent-template.yml,0,c563a8fe-0035-4705-886c-18e220790f77.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=4847 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c6c84613-dc10-4933-bc68-05012dde1649 EntryTimestamp=2021-04-14T11:06:17.895Z InvocationID=e876518c-2cf2-43c6-9ce9-136b115bbf24 LogTimestamp=2021-04-14T11:06:22.742685Z ResponseDesc=Created Exiting. 2021-04-14T11:06:22.743Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:22.816Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d7987b79-77cb-4f70-b2c7-9a45f056a115 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:22.816040Z InvocationID=94889b01-0c44-4271-9cef-39c890177912 LogTimestamp=2021-04-14T11:06:22.816111Z Entering 2021-04-14T11:06:22.816Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d7987b79-77cb-4f70-b2c7-9a45f056a115 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:22.816040Z InvocationID=94889b01-0c44-4271-9cef-39c890177912 LogTimestamp=2021-04-14T11:06:22.816111Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:23.533Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:23.534Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:23.534Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:23.534Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:23.935Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Webserver 2021-04-14T11:06:24.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6bfea8c-b9a6-418e-bfd4-972d7f6adc2e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:24.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6bfea8c-b9a6-418e-bfd4-972d7f6adc2e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@799298cd 2021-04-14T11:06:24.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6bfea8c-b9a6-418e-bfd4-972d7f6adc2e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:24.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6bfea8c-b9a6-418e-bfd4-972d7f6adc2e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:27.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f8e89a-e967-4ae6-b331-7c3ca79f3bae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:27.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f8e89a-e967-4ae6-b331-7c3ca79f3bae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e9cfa7c 2021-04-14T11:06:27.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f8e89a-e967-4ae6-b331-7c3ca79f3bae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:27.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f8e89a-e967-4ae6-b331-7c3ca79f3bae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:30.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24643ab9-e52e-489f-b93a-5a5fc6d5e4f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:30.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24643ab9-e52e-489f-b93a-5a5fc6d5e4f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c6b12a9 2021-04-14T11:06:30.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24643ab9-e52e-489f-b93a-5a5fc6d5e4f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:30.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24643ab9-e52e-489f-b93a-5a5fc6d5e4f1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:30.540Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "WebServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "200d82ff-1d28-4c0c-9c72-39458058ff66" INVARIANT_UUID = "67aef530-aaf8-4824-87ed-7b8434b9e749" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.WebServer" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=200d82ff-1d28-4c0c-9c72-39458058ff66 EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id d5e77987-9cb2-4b12-aa46-e3322bbcdca9 2021-04-14T11:06:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:06:31.282Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:06:32.641Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "WebServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "200d82ff-1d28-4c0c-9c72-39458058ff66" INVARIANT_UUID = "67aef530-aaf8-4824-87ed-7b8434b9e749" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d5e77987-9cb2-4b12-aa46-e3322bbcdca9.assettoscatemplate" CURR_ARTIFACT_UUID = "d5e77987-9cb2-4b12-aa46-e3322bbcdca9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Webserver-template.yml,0,d5e77987-9cb2-4b12-aa46-e3322bbcdca9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=9825 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f8fe5ee0-e638-44ca-b528-4907faf09033 EntryTimestamp=2021-04-14T11:06:22.816Z InvocationID=a071f6ab-24ee-4eb5-8c73-ed4f3e59a453 LogTimestamp=2021-04-14T11:06:32.641030Z ResponseDesc=Created Exiting. 2021-04-14T11:06:32.641Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:32.715Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5702de12-9533-4eaa-95ec-7aa1dad27e1b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:32.715719Z InvocationID=0d230ebc-9df9-4749-b8dc-50e7a4c8fc30 LogTimestamp=2021-04-14T11:06:32.715777Z Entering 2021-04-14T11:06:32.716Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5702de12-9533-4eaa-95ec-7aa1dad27e1b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:32.715719Z InvocationID=0d230ebc-9df9-4749-b8dc-50e7a4c8fc30 LogTimestamp=2021-04-14T11:06:32.715777Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:33.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=994c0f1c-6405-44bf-8c52-8a5ee8c27ef6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:33.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=994c0f1c-6405-44bf-8c52-8a5ee8c27ef6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@80478d5 2021-04-14T11:06:33.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=994c0f1c-6405-44bf-8c52-8a5ee8c27ef6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:33.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=994c0f1c-6405-44bf-8c52-8a5ee8c27ef6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:33.921Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:33.921Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:33.921Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:33.921Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:34.133Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Webapplication 2021-04-14T11:06:36.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c75185a-0f1a-4141-901d-3cf4723abbdb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:36.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c75185a-0f1a-4141-901d-3cf4723abbdb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@653dcde8 2021-04-14T11:06:36.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c75185a-0f1a-4141-901d-3cf4723abbdb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:36.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c75185a-0f1a-4141-901d-3cf4723abbdb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:37.313Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "WebApplication" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a9df4d40-57a6-4623-b5d4-d1263b076f7f" INVARIANT_UUID = "f2f7c241-a37c-42f4-b766-d18cb6fb9099" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.WebApplication" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a9df4d40-57a6-4623-b5d4-d1263b076f7f EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 82982216-5cc8-4315-aadc-ae3c1a65c63f 2021-04-14T11:06:39.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac2e97b-451d-4168-a10f-914284e8ca09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:39.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac2e97b-451d-4168-a10f-914284e8ca09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c7b8429 2021-04-14T11:06:39.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac2e97b-451d-4168-a10f-914284e8ca09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:39.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac2e97b-451d-4168-a10f-914284e8ca09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:39.227Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "WebApplication" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a9df4d40-57a6-4623-b5d4-d1263b076f7f" INVARIANT_UUID = "f2f7c241-a37c-42f4-b766-d18cb6fb9099" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "82982216-5cc8-4315-aadc-ae3c1a65c63f.assettoscatemplate" CURR_ARTIFACT_UUID = "82982216-5cc8-4315-aadc-ae3c1a65c63f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Webapplication-template.yml,0,82982216-5cc8-4315-aadc-ae3c1a65c63f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=6511 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0b5865cd-722c-4e5c-bbb6-c6b20ba40ac7 EntryTimestamp=2021-04-14T11:06:32.716Z InvocationID=f096fa40-951e-4b1c-af9e-60922708b7cb LogTimestamp=2021-04-14T11:06:39.227646Z ResponseDesc=Created Exiting. 2021-04-14T11:06:39.228Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:39.241Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=977bb97f-8db8-4ac0-a482-4a7e0cf2eba5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:39.241222Z InvocationID=5d0a8fc1-2147-476b-a05a-3cfb0ff834a0 LogTimestamp=2021-04-14T11:06:39.241272Z Entering 2021-04-14T11:06:39.241Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=977bb97f-8db8-4ac0-a482-4a7e0cf2eba5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:39.241222Z InvocationID=5d0a8fc1-2147-476b-a05a-3cfb0ff834a0 LogTimestamp=2021-04-14T11:06:39.241272Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:39.754Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:39.754Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:39.754Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:39.754Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:39.830Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Dbms 2021-04-14T11:06:41.311Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "DBMS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4f934adb-bef5-4216-a694-1785e74291c2" INVARIANT_UUID = "cfd01d5b-b049-4931-91d8-872bdc54f15c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.DBMS" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4f934adb-bef5-4216-a694-1785e74291c2 EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id de7c94f6-a32d-464a-845c-5dc703c30f21 2021-04-14T11:06:41.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78a5f411-5d92-4356-a959-2dc616c2636f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:41.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78a5f411-5d92-4356-a959-2dc616c2636f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c13d55 2021-04-14T11:06:41.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78a5f411-5d92-4356-a959-2dc616c2636f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:41.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78a5f411-5d92-4356-a959-2dc616c2636f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:42.951Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "DBMS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4f934adb-bef5-4216-a694-1785e74291c2" INVARIANT_UUID = "cfd01d5b-b049-4931-91d8-872bdc54f15c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "de7c94f6-a32d-464a-845c-5dc703c30f21.assettoscatemplate" CURR_ARTIFACT_UUID = "de7c94f6-a32d-464a-845c-5dc703c30f21.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Dbms-template.yml,0,de7c94f6-a32d-464a-845c-5dc703c30f21.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=3710 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1cc2b590-d8d4-4048-b687-e5bffa0f1d75 EntryTimestamp=2021-04-14T11:06:39.241Z InvocationID=0b874c5b-1882-464a-a9d4-b8c2ba1078ce LogTimestamp=2021-04-14T11:06:42.951213Z ResponseDesc=Created Exiting. 2021-04-14T11:06:42.951Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:43.019Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=23e88b44-4f7f-4e72-8feb-b9f5ce614bd5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:43.018659Z InvocationID=d8d0203d-6384-4705-9dfe-3dfba5a42558 LogTimestamp=2021-04-14T11:06:43.018724Z Entering 2021-04-14T11:06:43.019Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=23e88b44-4f7f-4e72-8feb-b9f5ce614bd5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:43.018659Z InvocationID=d8d0203d-6384-4705-9dfe-3dfba5a42558 LogTimestamp=2021-04-14T11:06:43.018724Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:43.914Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:43.914Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:43.914Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:43.914Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:44.130Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Database 2021-04-14T11:06:45.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b30a218-0e23-4d4e-99e5-3fe1b5ee54d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:45.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b30a218-0e23-4d4e-99e5-3fe1b5ee54d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a83a48 2021-04-14T11:06:45.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b30a218-0e23-4d4e-99e5-3fe1b5ee54d8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:45.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b30a218-0e23-4d4e-99e5-3fe1b5ee54d8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:06:46.252Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:06:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76baaaae-e5f8-4b25-929d-ac650354ade2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76baaaae-e5f8-4b25-929d-ac650354ade2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8f1e558 2021-04-14T11:06:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76baaaae-e5f8-4b25-929d-ac650354ade2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76baaaae-e5f8-4b25-929d-ac650354ade2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:50.681Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Database" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5a1f0eaf-4af7-4819-b728-08fa4bbc1798 EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:06:50.683Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Database" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5a1f0eaf-4af7-4819-b728-08fa4bbc1798 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:06:51.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09383a07-e91f-4789-ba50-ff7b9bb3cd4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:51.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09383a07-e91f-4789-ba50-ff7b9bb3cd4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@389b72a3 2021-04-14T11:06:51.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09383a07-e91f-4789-ba50-ff7b9bb3cd4c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:51.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09383a07-e91f-4789-ba50-ff7b9bb3cd4c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:52.524Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Database" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5a1f0eaf-4af7-4819-b728-08fa4bbc1798 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 ErrorCode=500 lock resource with id 377eea6b-7cf7-44b9-b52b-a24907bd0f74 2021-04-14T11:06:54.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe1bdd1-4b6c-4725-912a-099aec6ae1c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:54.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe1bdd1-4b6c-4725-912a-099aec6ae1c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1911cb70 2021-04-14T11:06:54.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe1bdd1-4b6c-4725-912a-099aec6ae1c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:54.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbe1bdd1-4b6c-4725-912a-099aec6ae1c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:54.334Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate" CURR_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Database-template.yml,0,377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d7826f1-9bb5-4d47-8213-ec76a6497aa3 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 ErrorCode=500 Starting to create Csar for component Database 2021-04-14T11:06:54.637Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate" CURR_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Database-template.yml,0,377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d7826f1-9bb5-4d47-8213-ec76a6497aa3 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 ErrorCode=500 Ended create Csar for component Database 2021-04-14T11:06:54.637Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate" CURR_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Database-template.yml,0,377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d7826f1-9bb5-4d47-8213-ec76a6497aa3 TargetServiceName=null EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 ErrorCode=500 lock resource with id 377eea6b-7cf7-44b9-b52b-a24907bd0f74 2021-04-14T11:06:56.806Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Database" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5a1f0eaf-4af7-4819-b728-08fa4bbc1798" INVARIANT_UUID = "1bbbf2be-ff18-4aa6-aee2-cb2e4c246879" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscacsar" CURR_ARTIFACT_UUID = "377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Database-csar.csar,0,377eea6b-7cf7-44b9-b52b-a24907bd0f74.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13787 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=38da046f-5e29-4ba6-aab4-efabbf95e94f TargetServiceName=null EntryTimestamp=2021-04-14T11:06:43.019Z InvocationID=d162434f-a0f0-4645-ac10-e14df47a4141 ErrorCode=500 LogTimestamp=2021-04-14T11:06:56.806225Z ResponseDesc=Created Exiting. 2021-04-14T11:06:56.807Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:06:56.828Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4372c325-6e79-45f7-aa63-58c884c1d104 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:56.828579Z InvocationID=234d50ae-267d-46cb-85a0-ad324c97ebb7 LogTimestamp=2021-04-14T11:06:56.828636Z Entering 2021-04-14T11:06:56.828Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4372c325-6e79-45f7-aa63-58c884c1d104 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:06:56.828579Z InvocationID=234d50ae-267d-46cb-85a0-ad324c97ebb7 LogTimestamp=2021-04-14T11:06:56.828636Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:06:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d3ac45-fb63-4583-bdb5-5a78736e906f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d3ac45-fb63-4583-bdb5-5a78736e906f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b29d860 2021-04-14T11:06:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d3ac45-fb63-4583-bdb5-5a78736e906f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2d3ac45-fb63-4583-bdb5-5a78736e906f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:58.016Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:58.016Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:58.016Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:58.016Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:06:58.187Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Objectstorage 2021-04-14T11:06:59.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30687e1a-2dc9-476d-9722-6bdf33a177c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:06:59.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30687e1a-2dc9-476d-9722-6bdf33a177c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c753d78 2021-04-14T11:06:59.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30687e1a-2dc9-476d-9722-6bdf33a177c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:06:59.722Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30687e1a-2dc9-476d-9722-6bdf33a177c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:06:59.925Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.ObjectStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1103a7b0-3d6d-4046-9fc4-dae8d17632bb EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:06:59.925Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.ObjectStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1103a7b0-3d6d-4046-9fc4-dae8d17632bb TargetServiceName=null EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:07:00.124Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.ObjectStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1103a7b0-3d6d-4046-9fc4-dae8d17632bb TargetServiceName=null EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 ErrorCode=500 lock resource with id f67166a9-316c-446d-a6e4-30b104678272 2021-04-14T11:07:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:07:01.225Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:07:01.715Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate" CURR_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Objectstorage-template.yml,0,f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a6a6a8ef-6b21-4bb5-b79c-af3d6123e98a TargetServiceName=null EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 ErrorCode=500 Starting to create Csar for component ObjectStorage 2021-04-14T11:07:01.940Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate" CURR_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Objectstorage-template.yml,0,f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a6a6a8ef-6b21-4bb5-b79c-af3d6123e98a TargetServiceName=null EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 ErrorCode=500 Ended create Csar for component ObjectStorage 2021-04-14T11:07:01.940Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate" CURR_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Objectstorage-template.yml,0,f67166a9-316c-446d-a6e4-30b104678272.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a6a6a8ef-6b21-4bb5-b79c-af3d6123e98a TargetServiceName=null EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 ErrorCode=500 lock resource with id f67166a9-316c-446d-a6e4-30b104678272 2021-04-14T11:07:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0c314e-ec24-4a92-b114-4964d3471256 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0c314e-ec24-4a92-b114-4964d3471256 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f98523f 2021-04-14T11:07:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0c314e-ec24-4a92-b114-4964d3471256 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b0c314e-ec24-4a92-b114-4964d3471256 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:04.153Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1103a7b0-3d6d-4046-9fc4-dae8d17632bb" INVARIANT_UUID = "7c34820a-9bea-483d-977c-bcf3f2852ba1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscacsar" CURR_ARTIFACT_UUID = "f67166a9-316c-446d-a6e4-30b104678272.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Objectstorage-csar.csar,0,f67166a9-316c-446d-a6e4-30b104678272.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7323 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f8addc03-7512-4ac1-a15f-5b4a94251c0f TargetServiceName=null EntryTimestamp=2021-04-14T11:06:56.829Z InvocationID=d1e5011d-94ab-4c84-9a43-8717760e45f3 ErrorCode=500 LogTimestamp=2021-04-14T11:07:04.152977Z ResponseDesc=Created Exiting. 2021-04-14T11:07:04.156Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:04.184Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5cd4964d-a603-489b-9214-8749fd8f679c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:04.183931Z InvocationID=74de6e84-a9c4-4e30-83fd-00ead2825471 LogTimestamp=2021-04-14T11:07:04.184007Z Entering 2021-04-14T11:07:04.184Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5cd4964d-a603-489b-9214-8749fd8f679c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:04.183931Z InvocationID=74de6e84-a9c4-4e30-83fd-00ead2825471 LogTimestamp=2021-04-14T11:07:04.184007Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:07:04.350Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:07:04.350Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:07:06.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3eb544f-dcb6-47d1-973d-02094564fbc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:06.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3eb544f-dcb6-47d1-973d-02094564fbc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c544f7 2021-04-14T11:07:06.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3eb544f-dcb6-47d1-973d-02094564fbc0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:06.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3eb544f-dcb6-47d1-973d-02094564fbc0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:08.639Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:08.640Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:08.640Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:08.640Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:08.817Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Blockstorage 2021-04-14T11:07:09.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:09.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dba6357 2021-04-14T11:07:09.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:09.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:12.419Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.BlockStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=97a5e944-f071-43a4-9ab7-ad44a35466aa EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:07:12.419Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.BlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=97a5e944-f071-43a4-9ab7-ad44a35466aa TargetServiceName=null EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:07:12.841Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:07:12.841Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:07:12.842Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:12.842Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cdb88a5f-061e-4222-8ed1-c2dd847432b7 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:13.117Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.BlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=97a5e944-f071-43a4-9ab7-ad44a35466aa TargetServiceName=null EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 ErrorCode=500 lock resource with id c60260e7-6469-43a5-acc7-ed2b0d6040cf 2021-04-14T11:07:13.633Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd8735f4-b76f-4316-a0ce-c311a975d9be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:13.633Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd8735f4-b76f-4316-a0ce-c311a975d9be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48d10765 2021-04-14T11:07:13.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd8735f4-b76f-4316-a0ce-c311a975d9be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:13.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd8735f4-b76f-4316-a0ce-c311a975d9be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:14.993Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate" CURR_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Blockstorage-template.yml,0,c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=11e23176-17e0-4926-b1ef-5fc4f36fe39f TargetServiceName=null EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 ErrorCode=500 Starting to create Csar for component BlockStorage 2021-04-14T11:07:15.198Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate" CURR_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Blockstorage-template.yml,0,c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=11e23176-17e0-4926-b1ef-5fc4f36fe39f TargetServiceName=null EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 ErrorCode=500 Ended create Csar for component BlockStorage 2021-04-14T11:07:15.199Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate" CURR_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Blockstorage-template.yml,0,c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=11e23176-17e0-4926-b1ef-5fc4f36fe39f TargetServiceName=null EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 ErrorCode=500 lock resource with id c60260e7-6469-43a5-acc7-ed2b0d6040cf 2021-04-14T11:07:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:07:16.387Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:07:16.388Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:07:16.434Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:07:16.434Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:07:16.441Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:07:16.441Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:07:16.445Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:07:16.446Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:07:16.449Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:07:16.449Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:07:16.453Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:07:16.453Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:07:16.456Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:07:16.456Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:07:16.464Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:07:16.464Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information. 2021-04-14T11:07:16.646Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fd8735f4-b76f-4316-a0ce-c311a975d9be ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:16.646Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fd8735f4-b76f-4316-a0ce-c311a975d9be ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:17.203Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "BlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "97a5e944-f071-43a4-9ab7-ad44a35466aa" INVARIANT_UUID = "1d77131d-f119-4bc4-b4da-e0f99c398bf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscacsar" CURR_ARTIFACT_UUID = "c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Blockstorage-csar.csar,0,c60260e7-6469-43a5-acc7-ed2b0d6040cf.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13019 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f8d6c2a7-2458-439d-b755-1e963731aabf TargetServiceName=null EntryTimestamp=2021-04-14T11:07:04.184Z InvocationID=2da99c37-f758-4c20-8fb7-aaba1ba30bc8 ErrorCode=500 LogTimestamp=2021-04-14T11:07:17.203365Z ResponseDesc=Created Exiting. 2021-04-14T11:07:17.204Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:17.222Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ccabcda4-ced4-43f6-9283-5fdf9e60af43 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:17.221927Z InvocationID=1d4f3045-26ff-4b63-97fb-37abb13cf8ad LogTimestamp=2021-04-14T11:07:17.221989Z Entering 2021-04-14T11:07:17.222Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ccabcda4-ced4-43f6-9283-5fdf9e60af43 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:17.221927Z InvocationID=1d4f3045-26ff-4b63-97fb-37abb13cf8ad LogTimestamp=2021-04-14T11:07:17.221989Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:17.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fad44e9-563d-48ea-8b3e-234adb0583df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:17.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fad44e9-563d-48ea-8b3e-234adb0583df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37c5b555 2021-04-14T11:07:17.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fad44e9-563d-48ea-8b3e-234adb0583df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:17.294Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fad44e9-563d-48ea-8b3e-234adb0583df PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:18.418Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:18.418Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:18.418Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:18.418Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:18.508Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0fad44e9-563d-48ea-8b3e-234adb0583df ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:18.509Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0fad44e9-563d-48ea-8b3e-234adb0583df ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:18.801Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Runtime 2021-04-14T11:07:19.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06b18c9-3561-44fc-8a9b-e012fe6d64d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:19.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06b18c9-3561-44fc-8a9b-e012fe6d64d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1921165a 2021-04-14T11:07:19.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06b18c9-3561-44fc-8a9b-e012fe6d64d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:19.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06b18c9-3561-44fc-8a9b-e012fe6d64d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:20.221Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Runtime" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d536c790-7157-4764-ad96-29845bcc7a37" INVARIANT_UUID = "dbfa9514-e5f4-403d-9cec-156340c3b4cc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Container.Runtime" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d536c790-7157-4764-ad96-29845bcc7a37 EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id d6c5e7f0-9294-4d2d-9e2b-5db5e7515cef 2021-04-14T11:07:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49be53ae-2312-4643-ac11-cd1cd95de4ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49be53ae-2312-4643-ac11-cd1cd95de4ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f3a279 2021-04-14T11:07:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49be53ae-2312-4643-ac11-cd1cd95de4ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49be53ae-2312-4643-ac11-cd1cd95de4ac PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:21.151Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK 2021-04-14T11:07:21.859Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Runtime" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d536c790-7157-4764-ad96-29845bcc7a37" INVARIANT_UUID = "dbfa9514-e5f4-403d-9cec-156340c3b4cc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d6c5e7f0-9294-4d2d-9e2b-5db5e7515cef.assettoscatemplate" CURR_ARTIFACT_UUID = "d6c5e7f0-9294-4d2d-9e2b-5db5e7515cef.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Runtime-template.yml,0,d6c5e7f0-9294-4d2d-9e2b-5db5e7515cef.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=4637 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=88b7e6b3-7038-4df7-ad42-0af12839dcf3 EntryTimestamp=2021-04-14T11:07:17.222Z InvocationID=e67d6ad6-c736-4edd-8c16-15cd9fcf65dd LogTimestamp=2021-04-14T11:07:21.859166Z ResponseDesc=Created Exiting. 2021-04-14T11:07:21.859Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:21.874Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6bdefccf-67d7-4bdb-bea2-beb715db9ae2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:21.873908Z InvocationID=71664702-301b-48b9-bb2d-99fd562ffef7 LogTimestamp=2021-04-14T11:07:21.873971Z Entering 2021-04-14T11:07:21.874Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6bdefccf-67d7-4bdb-bea2-beb715db9ae2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:21.873908Z InvocationID=71664702-301b-48b9-bb2d-99fd562ffef7 LogTimestamp=2021-04-14T11:07:21.873971Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:22.115Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:22.115Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:22.115Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:22.115Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:22.146Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Application 2021-04-14T11:07:24.409Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8503c06d-a746-4049-8f4a-607913f1f128 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:24.409Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8503c06d-a746-4049-8f4a-607913f1f128 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b86d00f 2021-04-14T11:07:24.409Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8503c06d-a746-4049-8f4a-607913f1f128 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:24.409Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8503c06d-a746-4049-8f4a-607913f1f128 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:25.032Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Application" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "78a18aeb-3f84-485c-b460-e1e16c9243bf" INVARIANT_UUID = "663b19a0-6cc4-4587-87c8-a0f39198d856" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.Container.Application" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=78a18aeb-3f84-485c-b460-e1e16c9243bf EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id c9cb0e92-8c51-451f-be91-ae783b389471 2021-04-14T11:07:27.413Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8503c06d-a746-4049-8f4a-607913f1f128 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:07:27.414Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8503c06d-a746-4049-8f4a-607913f1f128 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:07:27.414Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8503c06d-a746-4049-8f4a-607913f1f128 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:27.414Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8503c06d-a746-4049-8f4a-607913f1f128 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:28.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73286d06-17e8-44da-8a9f-6b863c752feb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:28.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73286d06-17e8-44da-8a9f-6b863c752feb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ccbd99e 2021-04-14T11:07:28.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73286d06-17e8-44da-8a9f-6b863c752feb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:28.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73286d06-17e8-44da-8a9f-6b863c752feb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:28.197Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Application" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "78a18aeb-3f84-485c-b460-e1e16c9243bf" INVARIANT_UUID = "663b19a0-6cc4-4587-87c8-a0f39198d856" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c9cb0e92-8c51-451f-be91-ae783b389471.assettoscatemplate" CURR_ARTIFACT_UUID = "c9cb0e92-8c51-451f-be91-ae783b389471.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Application-template.yml,0,c9cb0e92-8c51-451f-be91-ae783b389471.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=6323 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0c79e2b1-3001-42ea-b0b9-c1754129b2b5 EntryTimestamp=2021-04-14T11:07:21.874Z InvocationID=691b33f5-1a47-4fda-aa2c-3d11013aa38f LogTimestamp=2021-04-14T11:07:28.197650Z ResponseDesc=Created Exiting. 2021-04-14T11:07:28.198Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:28.290Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0c54335b-965a-4187-940a-f00e331aad72 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:28.290301Z InvocationID=304c38f6-5369-4a93-8ecd-d373cf5ba151 LogTimestamp=2021-04-14T11:07:28.290371Z Entering 2021-04-14T11:07:28.290Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0c54335b-965a-4187-940a-f00e331aad72 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:28.290301Z InvocationID=304c38f6-5369-4a93-8ecd-d373cf5ba151 LogTimestamp=2021-04-14T11:07:28.290371Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:30.438Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:30.438Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:30.438Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:30.438Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:30.730Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Loadbalancer 2021-04-14T11:07:31.045Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=73286d06-17e8-44da-8a9f-6b863c752feb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:31.045Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=73286d06-17e8-44da-8a9f-6b863c752feb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:07:31.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf2e06d-a08a-4e99-9650-f36932251212 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:31.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf2e06d-a08a-4e99-9650-f36932251212 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11b51431 2021-04-14T11:07:31.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf2e06d-a08a-4e99-9650-f36932251212 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:31.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf2e06d-a08a-4e99-9650-f36932251212 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:33.019Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.LoadBalancer" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecaec4b7-cfc5-4b61-b855-2e5b6be91f21 EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:07:33.019Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.LoadBalancer" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecaec4b7-cfc5-4b61-b855-2e5b6be91f21 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:07:33.720Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.LoadBalancer" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecaec4b7-cfc5-4b61-b855-2e5b6be91f21 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d ErrorCode=500 lock resource with id ae66233a-0583-4310-ab13-5d8dfa349e1e 2021-04-14T11:07:34.824Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=edf2e06d-a08a-4e99-9650-f36932251212 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:34.824Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=edf2e06d-a08a-4e99-9650-f36932251212 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:35.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f433c021-cd83-4635-8c6c-cc8986b1dbb5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:35.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f433c021-cd83-4635-8c6c-cc8986b1dbb5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e5b9184 2021-04-14T11:07:35.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f433c021-cd83-4635-8c6c-cc8986b1dbb5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:35.500Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f433c021-cd83-4635-8c6c-cc8986b1dbb5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:35.793Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate" CURR_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Loadbalancer-template.yml,0,ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dc645962-99db-4c10-ba46-c31410d53f51 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d ErrorCode=500 Starting to create Csar for component LoadBalancer 2021-04-14T11:07:36.009Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate" CURR_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Loadbalancer-template.yml,0,ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dc645962-99db-4c10-ba46-c31410d53f51 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d ErrorCode=500 Ended create Csar for component LoadBalancer 2021-04-14T11:07:36.010Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate" CURR_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Loadbalancer-template.yml,0,ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dc645962-99db-4c10-ba46-c31410d53f51 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d ErrorCode=500 lock resource with id ae66233a-0583-4310-ab13-5d8dfa349e1e 2021-04-14T11:07:38.018Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "LoadBalancer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ecaec4b7-cfc5-4b61-b855-2e5b6be91f21" INVARIANT_UUID = "3826ff79-4acc-4632-843d-ef2eddbdae61" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscacsar" CURR_ARTIFACT_UUID = "ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Loadbalancer-csar.csar,0,ae66233a-0583-4310-ab13-5d8dfa349e1e.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9727 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4f0ae7d5-001f-48a9-96c7-dd9cc4c6f024 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:28.290Z InvocationID=69f9835a-c2a0-4c7f-bdf5-9654db0c840d ErrorCode=500 LogTimestamp=2021-04-14T11:07:38.017776Z ResponseDesc=Created Exiting. 2021-04-14T11:07:38.019Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:38.041Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a1bf876d-90c1-4734-9e54-ae9e54c761b2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:38.041120Z InvocationID=9749e490-55f4-4a90-9bc7-cdd0ccf0e27c LogTimestamp=2021-04-14T11:07:38.041191Z Entering 2021-04-14T11:07:38.041Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a1bf876d-90c1-4734-9e54-ae9e54c761b2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:38.041120Z InvocationID=9749e490-55f4-4a90-9bc7-cdd0ccf0e27c LogTimestamp=2021-04-14T11:07:38.041191Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:38.130Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:07:38.132Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:07:38.512Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f433c021-cd83-4635-8c6c-cc8986b1dbb5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:38.513Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f433c021-cd83-4635-8c6c-cc8986b1dbb5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:39.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0f8045-0a42-4478-97bb-e52aa06857f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:39.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0f8045-0a42-4478-97bb-e52aa06857f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60263db 2021-04-14T11:07:39.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0f8045-0a42-4478-97bb-e52aa06857f5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:39.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b0f8045-0a42-4478-97bb-e52aa06857f5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:39.245Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=91195c20-f7a4-4c5e-bf94-e46f7f42aa23 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:39.244710Z InvocationID=cca84753-0ac2-4fac-88e5-3baac3b5c875 LogTimestamp=2021-04-14T11:07:39.244779Z Entering 2021-04-14T11:07:39.245Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=91195c20-f7a4-4c5e-bf94-e46f7f42aa23 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:39.244710Z InvocationID=cca84753-0ac2-4fac-88e5-3baac3b5c875 LogTimestamp=2021-04-14T11:07:39.244779Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:07:39.246Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:07:39.245Z InvocationID=c15bd510-d2fe-43da-805a-7920811b29de LogTimestamp=2021-04-14T11:07:39.246716Z ResponseDesc=OK Exiting. 2021-04-14T11:07:39.247Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:07:39.285Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:39.285Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:39.285Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:39.285Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:39.306Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Port 2021-04-14T11:07:40.505Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.network.Port" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=07421049-7df8-4418-bc98-3891234c5550 EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:07:40.506Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.network.Port" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=07421049-7df8-4418-bc98-3891234c5550 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:07:40.670Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.network.Port" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=07421049-7df8-4418-bc98-3891234c5550 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c ErrorCode=500 lock resource with id a0b27d49-71d6-45f2-bd55-e459393c2d97 2021-04-14T11:07:40.795Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b0f8045-0a42-4478-97bb-e52aa06857f5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:40.795Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9b0f8045-0a42-4478-97bb-e52aa06857f5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:40.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ebb734-3a54-43fc-ae4b-ff374f4eaa48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:40.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ebb734-3a54-43fc-ae4b-ff374f4eaa48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6de57fd4 2021-04-14T11:07:40.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ebb734-3a54-43fc-ae4b-ff374f4eaa48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:40.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ebb734-3a54-43fc-ae4b-ff374f4eaa48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca8d07d9-e48f-455f-bcef-d25d15ba0586 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca8d07d9-e48f-455f-bcef-d25d15ba0586 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dee5d8f 2021-04-14T11:07:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca8d07d9-e48f-455f-bcef-d25d15ba0586 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca8d07d9-e48f-455f-bcef-d25d15ba0586 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:42.321Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate" CURR_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Port-template.yml,0,a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=91e61ad1-222f-425f-89bf-6434ab357295 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c ErrorCode=500 Starting to create Csar for component Port 2021-04-14T11:07:42.521Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate" CURR_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Port-template.yml,0,a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=91e61ad1-222f-425f-89bf-6434ab357295 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c ErrorCode=500 Ended create Csar for component Port 2021-04-14T11:07:42.522Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate" CURR_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Port-template.yml,0,a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=91e61ad1-222f-425f-89bf-6434ab357295 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c ErrorCode=500 lock resource with id a0b27d49-71d6-45f2-bd55-e459393c2d97 2021-04-14T11:07:44.357Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "07421049-7df8-4418-bc98-3891234c5550" INVARIANT_UUID = "a746cac6-58da-446c-a868-92aac77bb737" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscacsar" CURR_ARTIFACT_UUID = "a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Port-csar.csar,0,a0b27d49-71d6-45f2-bd55-e459393c2d97.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6315 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=948ee559-548a-4227-bd85-8f3c56ca7cec TargetServiceName=null EntryTimestamp=2021-04-14T11:07:38.041Z InvocationID=492e521d-6898-42c9-9aaf-e1e013d7b27c ErrorCode=500 LogTimestamp=2021-04-14T11:07:44.356859Z ResponseDesc=Created Exiting. 2021-04-14T11:07:44.358Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:44.375Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:07:44.436Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e7adbb92-d352-4865-aa8c-821632b6b581 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:44.435755Z InvocationID=07fb3ae8-b6bf-4449-a4fc-bc6d6cfdddf4 LogTimestamp=2021-04-14T11:07:44.435824Z Entering 2021-04-14T11:07:44.436Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e7adbb92-d352-4865-aa8c-821632b6b581 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:44.435755Z InvocationID=07fb3ae8-b6bf-4449-a4fc-bc6d6cfdddf4 LogTimestamp=2021-04-14T11:07:44.435824Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:45.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=123fdc8b-c570-4b9b-a872-08922597960d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:45.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=123fdc8b-c570-4b9b-a872-08922597960d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38e7ef52 2021-04-14T11:07:45.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=123fdc8b-c570-4b9b-a872-08922597960d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:45.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=123fdc8b-c570-4b9b-a872-08922597960d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:07:47.547Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:07:47.548Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster. 2021-04-14T11:07:47.985Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:47.985Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:47.985Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:47.985Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:48.035Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=123fdc8b-c570-4b9b-a872-08922597960d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:07:48.035Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=123fdc8b-c570-4b9b-a872-08922597960d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:07:48.036Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=123fdc8b-c570-4b9b-a872-08922597960d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:48.036Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=123fdc8b-c570-4b9b-a872-08922597960d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:48.217Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Network 2021-04-14T11:07:48.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:48.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@773860d5 2021-04-14T11:07:48.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:48.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:50.828Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.network.Network" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e740851f-e405-4168-ad2d-b6268020e713 EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:07:50.829Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.network.Network" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e740851f-e405-4168-ad2d-b6268020e713 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:07:51.740Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:51.741Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:51.741Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:51.741Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7bd06a96-d4e1-4c80-8484-f3eb3aa818f3 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:07:52.115Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.network.Network" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e740851f-e405-4168-ad2d-b6268020e713 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be ErrorCode=500 lock resource with id f6207f59-7944-4771-94b9-716f8c36510d 2021-04-14T11:07:52.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9806f0c-9b04-44f8-9802-e8b8ef32f4ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:52.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9806f0c-9b04-44f8-9802-e8b8ef32f4ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e389baf 2021-04-14T11:07:52.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9806f0c-9b04-44f8-9802-e8b8ef32f4ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:52.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9806f0c-9b04-44f8-9802-e8b8ef32f4ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:53.833Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate" CURR_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Network-template.yml,0,f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=355f6159-96d4-4699-89e4-c44ce69df7e8 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be ErrorCode=500 Starting to create Csar for component Network 2021-04-14T11:07:54.036Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate" CURR_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Network-template.yml,0,f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=355f6159-96d4-4699-89e4-c44ce69df7e8 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be ErrorCode=500 Ended create Csar for component Network 2021-04-14T11:07:54.037Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate" CURR_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Network-template.yml,0,f6207f59-7944-4771-94b9-716f8c36510d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=355f6159-96d4-4699-89e4-c44ce69df7e8 TargetServiceName=null EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be ErrorCode=500 lock resource with id f6207f59-7944-4771-94b9-716f8c36510d 2021-04-14T11:07:55.441Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f9806f0c-9b04-44f8-9802-e8b8ef32f4ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:55.441Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f9806f0c-9b04-44f8-9802-e8b8ef32f4ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:55.918Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Network" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e740851f-e405-4168-ad2d-b6268020e713" INVARIANT_UUID = "7f771189-715d-412d-b50b-d29032ac7757" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscacsar" CURR_ARTIFACT_UUID = "f6207f59-7944-4771-94b9-716f8c36510d.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Network-csar.csar,0,f6207f59-7944-4771-94b9-716f8c36510d.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=11481 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f765f62e-b8a1-4a4b-aea0-27126097f38c TargetServiceName=null EntryTimestamp=2021-04-14T11:07:44.436Z InvocationID=d3ae96c6-5944-4ab3-a056-6542ecb0e8be ErrorCode=500 LogTimestamp=2021-04-14T11:07:55.917742Z ResponseDesc=Created Exiting. 2021-04-14T11:07:55.918Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:07:55.992Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1d1d9414-e4b4-4d67-b265-6884895db696 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:55.991991Z InvocationID=a7c0c31a-fb89-4e17-bfe7-5583714b4f08 LogTimestamp=2021-04-14T11:07:55.992082Z Entering 2021-04-14T11:07:55.992Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1d1d9414-e4b4-4d67-b265-6884895db696 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:07:55.991991Z InvocationID=a7c0c31a-fb89-4e17-bfe7-5583714b4f08 LogTimestamp=2021-04-14T11:07:55.992082Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:07:56.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae6a6af-6fcd-44ae-aee2-292fc7803646 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:56.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae6a6af-6fcd-44ae-aee2-292fc7803646 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5da89f7c 2021-04-14T11:07:56.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae6a6af-6fcd-44ae-aee2-292fc7803646 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:56.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eae6a6af-6fcd-44ae-aee2-292fc7803646 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:57.012Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:57.012Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:57.012Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:57.012Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:07:57.095Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Globalnetwork 2021-04-14T11:07:59.120Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eae6a6af-6fcd-44ae-aee2-292fc7803646 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:07:59.121Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eae6a6af-6fcd-44ae-aee2-292fc7803646 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:07:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4589088-ed2b-428a-9c2f-f34992075363 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:07:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4589088-ed2b-428a-9c2f-f34992075363 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bcf5cee 2021-04-14T11:07:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4589088-ed2b-428a-9c2f-f34992075363 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:07:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4589088-ed2b-428a-9c2f-f34992075363 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:07:59.737Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "GlobalNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "fb8df105-686c-44ec-ae0e-5837e10f2c38" INVARIANT_UUID = "2b2a4855-0b81-4e71-a7ec-aa2cf17e08b9" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.network.Network" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fb8df105-686c-44ec-ae0e-5837e10f2c38 EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 8aa5e594-8735-4f74-a214-19147dc9da91 2021-04-14T11:08:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:08:01.395Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "GlobalNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "fb8df105-686c-44ec-ae0e-5837e10f2c38" INVARIANT_UUID = "2b2a4855-0b81-4e71-a7ec-aa2cf17e08b9" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8aa5e594-8735-4f74-a214-19147dc9da91.assettoscatemplate" CURR_ARTIFACT_UUID = "8aa5e594-8735-4f74-a214-19147dc9da91.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Globalnetwork-template.yml,0,8aa5e594-8735-4f74-a214-19147dc9da91.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=5402 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=31307b2c-13cb-478e-a21b-8a110259558e EntryTimestamp=2021-04-14T11:07:55.992Z InvocationID=def834b3-7942-4875-a53b-d3287d8c7a45 LogTimestamp=2021-04-14T11:08:01.394499Z ResponseDesc=Created Exiting. 2021-04-14T11:08:01.395Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:01.412Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9e92e7af-7dea-4046-a9d9-9f97aa1e2437 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:01.412005Z InvocationID=4458ac04-4209-4fb0-81c8-1d443e6ac6d2 LogTimestamp=2021-04-14T11:08:01.412101Z Entering 2021-04-14T11:08:01.412Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9e92e7af-7dea-4046-a9d9-9f97aa1e2437 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:01.412005Z InvocationID=4458ac04-4209-4fb0-81c8-1d443e6ac6d2 LogTimestamp=2021-04-14T11:08:01.412101Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:01.812Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:01.812Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:01.812Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:01.812Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:01.833Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Globalport 2021-04-14T11:08:02.744Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f4589088-ed2b-428a-9c2f-f34992075363 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:02.745Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f4589088-ed2b-428a-9c2f-f34992075363 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:03.636Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=937585af-7a2e-4b56-a518-18b82231c151 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:03.635412Z InvocationID=8ed9ddc0-e6f3-4dd6-a8c8-867ab0068025 LogTimestamp=2021-04-14T11:08:03.635525Z Entering 2021-04-14T11:08:03.636Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=937585af-7a2e-4b56-a518-18b82231c151 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServiceName=v1/registerForDistribution ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:03.635412Z InvocationID=8ed9ddc0-e6f3-4dd6-a8c8-867ab0068025 LogTimestamp=2021-04-14T11:08:03.635525Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 POST /sdc/v1/registerForDistribution HTTP/1.1 2021-04-14T11:08:03.642Z [qtp580718781-19] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/59AmN14TKojiBJqO will send credentials over a clear channel. 2021-04-14T11:08:03.642Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-STATUS-TOPIC-AUTO/producers/59AmN14TKojiBJqO (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:08:03.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29735415-b44e-44e8-9109-25e4a51e21e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:03.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29735415-b44e-44e8-9109-25e4a51e21e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8ffb3bb 2021-04-14T11:08:03.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29735415-b44e-44e8-9109-25e4a51e21e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:03.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29735415-b44e-44e8-9109-25e4a51e21e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:08:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:08:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:08:04.644Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "GlobalPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "52902ed4-1e4b-4934-9e72-01dc992baa0a" INVARIANT_UUID = "6448f039-40bb-46e2-a9ba-d5fa263c3744" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.Port" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=52902ed4-1e4b-4934-9e72-01dc992baa0a EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id f3785ee5-a206-4178-83f2-b857c5c63140 2021-04-14T11:08:06.825Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=29735415-b44e-44e8-9109-25e4a51e21e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:06.825Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=29735415-b44e-44e8-9109-25e4a51e21e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:07.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a9b5aa-9998-4793-9bca-e7887cf7ad2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:07.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a9b5aa-9998-4793-9bca-e7887cf7ad2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a91e953 2021-04-14T11:08:07.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a9b5aa-9998-4793-9bca-e7887cf7ad2a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:07.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a9b5aa-9998-4793-9bca-e7887cf7ad2a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:08.062Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "GlobalPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "52902ed4-1e4b-4934-9e72-01dc992baa0a" INVARIANT_UUID = "6448f039-40bb-46e2-a9ba-d5fa263c3744" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f3785ee5-a206-4178-83f2-b857c5c63140.assettoscatemplate" CURR_ARTIFACT_UUID = "f3785ee5-a206-4178-83f2-b857c5c63140.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Globalport-template.yml,0,f3785ee5-a206-4178-83f2-b857c5c63140.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=6649 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b63b031f-a5d8-4e67-b8ed-e25b9d546952 EntryTimestamp=2021-04-14T11:08:01.412Z InvocationID=a3c99cdd-65ef-4e9a-9901-6121268fae0b LogTimestamp=2021-04-14T11:08:08.061658Z ResponseDesc=Created Exiting. 2021-04-14T11:08:08.062Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:08.286Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=88678a6a-fbde-499f-bb16-21b074bb9089 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:08.286080Z InvocationID=6ed85e9b-96c4-4fda-84cb-c254e45a8d67 LogTimestamp=2021-04-14T11:08:08.286173Z Entering 2021-04-14T11:08:08.286Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=88678a6a-fbde-499f-bb16-21b074bb9089 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:08.286080Z InvocationID=6ed85e9b-96c4-4fda-84cb-c254e45a8d67 LogTimestamp=2021-04-14T11:08:08.286173Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:09.187Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information. 2021-04-14T11:08:09.304Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:08:09.306Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:08:09.386Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:08:09.829Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:08:09.835Z [qtp580718781-19] WARN c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "59AmN14TKojiBJqO" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/59AmN14TKojiBJqO will send credentials over a clear channel. 2021-04-14T11:08:09.835Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "59AmN14TKojiBJqO" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m PUT http://message-router.onap:3904/topics/SDC-DISTR-NOTIF-TOPIC-AUTO/consumers/59AmN14TKojiBJqO (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:08:09.954Z [qtp580718781-19] INFO c.att.nsa.apiClient.http.HttpClient AuditMessage=ACTION = "AddKeyToTopicACL" D_ENV = "AUTO" TOPIC_NAME = "SDC-DISTR-STATUS-TOPIC-AUTO" ROLE = "PRODUCER" API_KEY = "59AmN14TKojiBJqO" STATUS = "200" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m \t--> HTTP/1.1 200 OK 2021-04-14T11:08:10.033Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "DRegister" CONSUMER_ID = "clamp" API_KEY = "59AmN14TKojiBJqO" D_ENV = "AUTO" STATUS = "200" DESC = "" DNOTIF_TOPIC = "SDC-DISTR-NOTIF-TOPIC-AUTO" DSTATUS_TOPIC = "SDC-DISTR-STATUS-TOPIC-AUTO" ResponseCode=200 RequestID=null ElapsedTime=6396 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/registerForDistribution EntryTimestamp=2021-04-14T11:08:03.636Z InvocationID=bda7cc4d-7f0a-4f1c-9fc8-f86abf725617 LogTimestamp=2021-04-14T11:08:10.032662Z ResponseDesc=OK Exiting. 2021-04-14T11:08:10.033Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc/v1/registerForDistribution HTTP/1.1 SC="200" 2021-04-14T11:08:10.746Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:10.746Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:10.746Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:10.747Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:10.829Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b7a9b5aa-9998-4793-9bca-e7887cf7ad2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:10.829Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b7a9b5aa-9998-4793-9bca-e7887cf7ad2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:10.844Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Globalcompute 2021-04-14T11:08:11.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fb4151-4049-456c-82df-eab9098364b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:11.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fb4151-4049-456c-82df-eab9098364b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1262c34c 2021-04-14T11:08:11.639Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fb4151-4049-456c-82df-eab9098364b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:11.639Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9fb4151-4049-456c-82df-eab9098364b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:13.733Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "GlobalCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5010ac5a-2537-4587-b4d8-3a3b9c3a8261" INVARIANT_UUID = "1284d3e2-f89a-4227-992a-980d27edc7d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.Compute" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5010ac5a-2537-4587-b4d8-3a3b9c3a8261 EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id eb440678-e366-43a8-ba96-d62c65d1db39 2021-04-14T11:08:13.832Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e9fb4151-4049-456c-82df-eab9098364b9 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:13.832Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e9fb4151-4049-456c-82df-eab9098364b9 ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:14.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:14.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bef23de 2021-04-14T11:08:14.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:14.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:15.718Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "GlobalCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5010ac5a-2537-4587-b4d8-3a3b9c3a8261" INVARIANT_UUID = "1284d3e2-f89a-4227-992a-980d27edc7d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "eb440678-e366-43a8-ba96-d62c65d1db39.assettoscatemplate" CURR_ARTIFACT_UUID = "eb440678-e366-43a8-ba96-d62c65d1db39.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Globalcompute-template.yml,0,eb440678-e366-43a8-ba96-d62c65d1db39.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=7432 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9621eaba-645a-4eb2-8e9f-54f97c074e3d EntryTimestamp=2021-04-14T11:08:08.286Z InvocationID=72ab8be0-8161-4799-875e-4c6df6bdc99c LogTimestamp=2021-04-14T11:08:15.718153Z ResponseDesc=Created Exiting. 2021-04-14T11:08:15.718Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:15.735Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cc79c7fa-9cad-4401-abcf-2de303052f64 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:15.735101Z InvocationID=f58cabd7-c15e-436f-be85-f287f7c48826 LogTimestamp=2021-04-14T11:08:15.735144Z Entering 2021-04-14T11:08:15.735Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cc79c7fa-9cad-4401-abcf-2de303052f64 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:15.735101Z InvocationID=f58cabd7-c15e-436f-be85-f287f7c48826 LogTimestamp=2021-04-14T11:08:15.735144Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:08:16.221Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:08:16.222Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster. 2021-04-14T11:08:16.698Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:16.698Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:16.698Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:16.698Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:16.698Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Volume 2021-04-14T11:08:17.725Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:08:17.725Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:08:17.725Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:17.725Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b2a8890d-3fd9-495b-ad21-24eda57bb010 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:18.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:18.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2602a87 2021-04-14T11:08:18.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:18.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:18.532Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.volume" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=82243c44-ea7c-41e2-949c-907962a80b58 EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:08:18.533Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.volume" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=82243c44-ea7c-41e2-949c-907962a80b58 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:08:19.219Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.volume" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=82243c44-ea7c-41e2-949c-907962a80b58 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb ErrorCode=500 lock resource with id e237c1f4-acdf-4e22-b61a-47d3057ff5d5 2021-04-14T11:08:20.833Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate" CURR_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Volume-template.yml,0,e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d527cbd-4b89-4579-b841-6c49bba6c30d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb ErrorCode=500 Starting to create Csar for component volume 2021-04-14T11:08:21.061Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate" CURR_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Volume-template.yml,0,e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d527cbd-4b89-4579-b841-6c49bba6c30d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb ErrorCode=500 Ended create Csar for component volume 2021-04-14T11:08:21.062Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate" CURR_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Volume-template.yml,0,e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d527cbd-4b89-4579-b841-6c49bba6c30d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb ErrorCode=500 lock resource with id e237c1f4-acdf-4e22-b61a-47d3057ff5d5 2021-04-14T11:08:21.311Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:21.311Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:21.311Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:21.311Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0e1c768a-456c-40a8-bc88-89a98160a159 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:21.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615798d6-adb6-4dd5-bdd6-ad4d65917080 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:21.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615798d6-adb6-4dd5-bdd6-ad4d65917080 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14becb4d 2021-04-14T11:08:21.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615798d6-adb6-4dd5-bdd6-ad4d65917080 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:21.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615798d6-adb6-4dd5-bdd6-ad4d65917080 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:22.731Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "volume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "82243c44-ea7c-41e2-949c-907962a80b58" INVARIANT_UUID = "0b108cd8-7c3b-4625-9b48-61218f5d9720" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscacsar" CURR_ARTIFACT_UUID = "e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Volume-csar.csar,0,e237c1f4-acdf-4e22-b61a-47d3057ff5d5.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6995 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f450336-276c-44cf-b03c-0f10592ba42b TargetServiceName=null EntryTimestamp=2021-04-14T11:08:15.735Z InvocationID=8deb61b0-1a66-4aec-8fd0-8aea724439eb ErrorCode=500 LogTimestamp=2021-04-14T11:08:22.730719Z ResponseDesc=Created Exiting. 2021-04-14T11:08:22.731Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:22.754Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cd0abb0d-6fbf-4a22-81f7-e85a4fda3ea8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:22.753800Z InvocationID=29a62fea-0b8c-40f5-a4c8-0cfb05b5f76c LogTimestamp=2021-04-14T11:08:22.753850Z Entering 2021-04-14T11:08:22.754Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cd0abb0d-6fbf-4a22-81f7-e85a4fda3ea8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:22.753800Z InvocationID=29a62fea-0b8c-40f5-a4c8-0cfb05b5f76c LogTimestamp=2021-04-14T11:08:22.753850Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:23.626Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:23.626Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:23.626Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:23.627Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:23.627Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Cindervolume 2021-04-14T11:08:24.501Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=615798d6-adb6-4dd5-bdd6-ad4d65917080 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:24.501Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=615798d6-adb6-4dd5-bdd6-ad4d65917080 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:25.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9508a5-3284-4de3-9a92-e2f0c7582cc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:25.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9508a5-3284-4de3-9a92-e2f0c7582cc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25cad99d 2021-04-14T11:08:25.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9508a5-3284-4de3-9a92-e2f0c7582cc5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:25.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e9508a5-3284-4de3-9a92-e2f0c7582cc5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:27.333Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.cinder.Volume" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d5cc114c-c196-4809-aab3-b213bb6099f4 EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:08:27.333Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.cinder.Volume" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d5cc114c-c196-4809-aab3-b213bb6099f4 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:08:28.231Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9e9508a5-3284-4de3-9a92-e2f0c7582cc5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:28.231Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9e9508a5-3284-4de3-9a92-e2f0c7582cc5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:29.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6fb30d9-78e5-42a4-9223-c2412a42aa74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:29.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6fb30d9-78e5-42a4-9223-c2412a42aa74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26b8c6a8 2021-04-14T11:08:29.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6fb30d9-78e5-42a4-9223-c2412a42aa74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:29.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6fb30d9-78e5-42a4-9223-c2412a42aa74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:29.840Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.cinder.Volume" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d5cc114c-c196-4809-aab3-b213bb6099f4 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 ErrorCode=500 lock resource with id a5323ad2-0157-4211-988f-d438d0216810 2021-04-14T11:08:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:08:31.422Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d6fb30d9-78e5-42a4-9223-c2412a42aa74 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:31.422Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d6fb30d9-78e5-42a4-9223-c2412a42aa74 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:31.929Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate" CURR_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Cindervolume-template.yml,0,a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9b2bb840-e899-46d0-a3fa-3f522ce821fa TargetServiceName=null EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 ErrorCode=500 Starting to create Csar for component CinderVolume 2021-04-14T11:08:32.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24ddc1b3-c9e9-466f-a746-72e048c967b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:32.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24ddc1b3-c9e9-466f-a746-72e048c967b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ca708bd 2021-04-14T11:08:32.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24ddc1b3-c9e9-466f-a746-72e048c967b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:32.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24ddc1b3-c9e9-466f-a746-72e048c967b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:32.232Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate" CURR_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Cindervolume-template.yml,0,a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9b2bb840-e899-46d0-a3fa-3f522ce821fa TargetServiceName=null EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 ErrorCode=500 Ended create Csar for component CinderVolume 2021-04-14T11:08:32.233Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate" CURR_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Cindervolume-template.yml,0,a5323ad2-0157-4211-988f-d438d0216810.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9b2bb840-e899-46d0-a3fa-3f522ce821fa TargetServiceName=null EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 ErrorCode=500 lock resource with id a5323ad2-0157-4211-988f-d438d0216810 2021-04-14T11:08:33.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:33.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ce7faf9 2021-04-14T11:08:33.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:33.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:34.249Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "CinderVolume" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d5cc114c-c196-4809-aab3-b213bb6099f4" INVARIANT_UUID = "5a654be4-1d9b-4e1a-b0ce-b70f36599ad0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscacsar" CURR_ARTIFACT_UUID = "a5323ad2-0157-4211-988f-d438d0216810.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Cindervolume-csar.csar,0,a5323ad2-0157-4211-988f-d438d0216810.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=11494 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4b7f92d8-d5ae-4611-a997-5ecd883dd690 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:22.754Z InvocationID=a50d588f-5c64-4072-a56e-f0f00c8ffbf6 ErrorCode=500 LogTimestamp=2021-04-14T11:08:34.248912Z ResponseDesc=Created Exiting. 2021-04-14T11:08:34.252Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:34.316Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f0d7162d-8ae0-456e-b915-ca8dfa2eb86f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:34.316629Z InvocationID=30a008d1-3d6c-4c6b-b829-7adea162f3cb LogTimestamp=2021-04-14T11:08:34.316693Z Entering 2021-04-14T11:08:34.317Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f0d7162d-8ae0-456e-b915-ca8dfa2eb86f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:34.316629Z InvocationID=30a008d1-3d6c-4c6b-b829-7adea162f3cb LogTimestamp=2021-04-14T11:08:34.316693Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:35.193Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:35.193Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:35.193Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:35.193Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:35.297Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailvirtualnetwork 2021-04-14T11:08:36.525Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:08:36.525Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.io.ChunkedInputStream.getChunkSize(ChunkedInputStream.java:253) at org.apache.http.impl.io.ChunkedInputStream.nextChunk(ChunkedInputStream.java:227) at org.apache.http.impl.io.ChunkedInputStream.read(ChunkedInputStream.java:186) at org.apache.http.conn.EofSensorInputStream.read(EofSensorInputStream.java:135) at java.base/sun.nio.cs.StreamDecoder.readBytes(Unknown Source) at java.base/sun.nio.cs.StreamDecoder.implRead(Unknown Source) at java.base/sun.nio.cs.StreamDecoder.read(Unknown Source) at java.base/java.io.InputStreamReader.read(Unknown Source) at java.base/java.io.Reader.read(Unknown Source) at org.apache.http.util.EntityUtils.toString(EntityUtils.java:247) at org.apache.http.util.EntityUtils.toString(EntityUtils.java:291) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.lambda$new$1(HttpRequestHandler.java:63) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:112) ... 13 common frames omitted 2021-04-14T11:08:36.525Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:36.526Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=963a1fad-cde1-4cdb-9939-cfa1905618e8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:37.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b012b9ea-0a19-45a8-81cd-94198ba08972 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:37.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b012b9ea-0a19-45a8-81cd-94198ba08972 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c0ae44b 2021-04-14T11:08:37.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b012b9ea-0a19-45a8-81cd-94198ba08972 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:37.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b012b9ea-0a19-45a8-81cd-94198ba08972 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:37.300Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.contrail.VirtualNetwork" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=02b00dc6-32c0-4e36-adfc-5835533b7578 EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:08:37.300Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.contrail.VirtualNetwork" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=02b00dc6-32c0-4e36-adfc-5835533b7578 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:08:37.634Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:08:37.635Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:08:37.994Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.contrail.VirtualNetwork" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=02b00dc6-32c0-4e36-adfc-5835533b7578 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 ErrorCode=500 lock resource with id 4381985a-a3f4-43cb-9f7f-d8bbde2c8332 2021-04-14T11:08:38.694Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b012b9ea-0a19-45a8-81cd-94198ba08972 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:38.694Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b012b9ea-0a19-45a8-81cd-94198ba08972 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:39.187Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information. 2021-04-14T11:08:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc1644c-9316-4a1a-8229-c146c8cb657c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc1644c-9316-4a1a-8229-c146c8cb657c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16f756d0 2021-04-14T11:08:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc1644c-9316-4a1a-8229-c146c8cb657c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbc1644c-9316-4a1a-8229-c146c8cb657c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:39.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de74ec8a-5cb3-4de3-b4c6-1334bd6f59fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:39.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de74ec8a-5cb3-4de3-b4c6-1334bd6f59fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55446c5 2021-04-14T11:08:39.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de74ec8a-5cb3-4de3-b4c6-1334bd6f59fd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:39.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de74ec8a-5cb3-4de3-b4c6-1334bd6f59fd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:39.899Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate" CURR_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailvirtualnetwork-template.yml,0,4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=771603cc-a322-4182-939b-67a356c1b255 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 ErrorCode=500 Starting to create Csar for component ContrailVirtualNetwork 2021-04-14T11:08:39.934Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=de74ec8a-5cb3-4de3-b4c6-1334bd6f59fd ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:39.934Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=de74ec8a-5cb3-4de3-b4c6-1334bd6f59fd ErrorCategory=INFO ServiceName=BE Component DE state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:40.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b89ef9-6236-42e1-954a-f954b33ff32c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:40.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b89ef9-6236-42e1-954a-f954b33ff32c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee7d298 2021-04-14T11:08:40.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b89ef9-6236-42e1-954a-f954b33ff32c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:40.067Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b89ef9-6236-42e1-954a-f954b33ff32c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:40.098Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate" CURR_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailvirtualnetwork-template.yml,0,4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=771603cc-a322-4182-939b-67a356c1b255 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 ErrorCode=500 Ended create Csar for component ContrailVirtualNetwork 2021-04-14T11:08:40.098Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate" CURR_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailvirtualnetwork-template.yml,0,4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=771603cc-a322-4182-939b-67a356c1b255 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 ErrorCode=500 lock resource with id 4381985a-a3f4-43cb-9f7f-d8bbde2c8332 2021-04-14T11:08:40.173Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 200 OK 2021-04-14T11:08:40.835Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:08:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eb7a871-aeed-4f54-8d6e-3d577a044d50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eb7a871-aeed-4f54-8d6e-3d577a044d50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26f8fc95 2021-04-14T11:08:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eb7a871-aeed-4f54-8d6e-3d577a044d50 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0eb7a871-aeed-4f54-8d6e-3d577a044d50 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:41.713Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailVirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "02b00dc6-32c0-4e36-adfc-5835533b7578" INVARIANT_UUID = "6e70b7ff-0db1-4698-848c-b72ecb08f546" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscacsar" CURR_ARTIFACT_UUID = "4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailvirtualnetwork-csar.csar,0,4381985a-a3f4-43cb-9f7f-d8bbde2c8332.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7395 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=990ea502-fd40-464c-abfa-ade69e28fcd6 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:34.317Z InvocationID=39e93488-b713-445d-8874-e6ae5c85d1a5 ErrorCode=500 LogTimestamp=2021-04-14T11:08:41.712970Z ResponseDesc=Created Exiting. 2021-04-14T11:08:41.713Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:41.728Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9b94a37d-1abd-45a8-8166-81f676a7a53e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:41.728594Z InvocationID=0afbb95b-7fc4-4ab1-b680-b383b3388fe3 LogTimestamp=2021-04-14T11:08:41.728677Z Entering 2021-04-14T11:08:41.729Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9b94a37d-1abd-45a8-8166-81f676a7a53e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:41.728594Z InvocationID=0afbb95b-7fc4-4ab1-b680-b383b3388fe3 LogTimestamp=2021-04-14T11:08:41.728677Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:41.960Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:41.960Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:41.960Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:41.960Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:41.973Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Neutronnet 2021-04-14T11:08:43.734Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.neutron.Net" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f138ad06-00e0-4d26-bcf5-9c06f68ff7f5 EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:08:43.734Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.neutron.Net" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f138ad06-00e0-4d26-bcf5-9c06f68ff7f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:08:45.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:45.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a957f4c 2021-04-14T11:08:45.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:45.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:45.586Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.neutron.Net" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f138ad06-00e0-4d26-bcf5-9c06f68ff7f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b ErrorCode=500 lock resource with id 8be27024-b714-4f4a-9747-0430f36f7ec4 2021-04-14T11:08:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:08:47.788Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 200 OK 2021-04-14T11:08:47.789Z [UEB-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend connection recovery to UEB Cluster. 2021-04-14T11:08:48.241Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:08:48.241Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:08:48.242Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:48.242Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fa1f4223-7ee3-4c71-8cf0-941d4c0ea990 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:48.331Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate" CURR_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Neutronnet-template.yml,0,8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4e35b222-ab1d-4445-9b0c-9688a86b4e83 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b ErrorCode=500 Starting to create Csar for component NeutronNet 2021-04-14T11:08:48.531Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate" CURR_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Neutronnet-template.yml,0,8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4e35b222-ab1d-4445-9b0c-9688a86b4e83 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b ErrorCode=500 Ended create Csar for component NeutronNet 2021-04-14T11:08:48.531Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate" CURR_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Neutronnet-template.yml,0,8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4e35b222-ab1d-4445-9b0c-9688a86b4e83 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b ErrorCode=500 lock resource with id 8be27024-b714-4f4a-9747-0430f36f7ec4 2021-04-14T11:08:49.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:49.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d5062b5 2021-04-14T11:08:49.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:49.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:50.855Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "f138ad06-00e0-4d26-bcf5-9c06f68ff7f5" INVARIANT_UUID = "005d99ce-2841-4060-b374-849359531084" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscacsar" CURR_ARTIFACT_UUID = "8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Neutronnet-csar.csar,0,8be27024-b714-4f4a-9747-0430f36f7ec4.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9126 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a7b9c6b-7c7f-4dd6-a953-40d49e35433d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:41.729Z InvocationID=84ccbcb8-3c65-46ce-86b1-a92358021b1b ErrorCode=500 LogTimestamp=2021-04-14T11:08:50.855430Z ResponseDesc=Created Exiting. 2021-04-14T11:08:50.856Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:50.935Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=76019d85-7e57-4a90-9fbd-4601c5019c70 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:50.935536Z InvocationID=640d408a-beee-4253-bd1c-08eff5a6774f LogTimestamp=2021-04-14T11:08:50.935603Z Entering 2021-04-14T11:08:50.936Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=76019d85-7e57-4a90-9fbd-4601c5019c70 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:50.935536Z InvocationID=640d408a-beee-4253-bd1c-08eff5a6774f LogTimestamp=2021-04-14T11:08:50.935603Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:52.216Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:52.216Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:52.217Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:52.217Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:52.238Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Neutronport 2021-04-14T11:08:52.241Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:52.241Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:52.241Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:52.241Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6445e8f9-ab66-48a1-9fe7-01e2b2633f75 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:08:53.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb964f77-ddd9-4923-9785-a0f36604994e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:53.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb964f77-ddd9-4923-9785-a0f36604994e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cfe5fe4 2021-04-14T11:08:53.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb964f77-ddd9-4923-9785-a0f36604994e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:53.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb964f77-ddd9-4923-9785-a0f36604994e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:54.135Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.neutron.Port" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6aef98ed-9be9-4990-b73b-7407a979fe47 EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:08:54.136Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.neutron.Port" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6aef98ed-9be9-4990-b73b-7407a979fe47 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:08:54.499Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.neutron.Port" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6aef98ed-9be9-4990-b73b-7407a979fe47 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 ErrorCode=500 lock resource with id 1f0a9fb4-5803-485c-9186-7a605af8de8d 2021-04-14T11:08:56.230Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eb964f77-ddd9-4923-9785-a0f36604994e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:08:56.231Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eb964f77-ddd9-4923-9785-a0f36604994e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:08:56.497Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate" CURR_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Neutronport-template.yml,0,1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d6557bc0-faee-49b5-9bb1-724e63d7309e TargetServiceName=null EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 ErrorCode=500 Starting to create Csar for component NeutronPort 2021-04-14T11:08:56.717Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate" CURR_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Neutronport-template.yml,0,1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d6557bc0-faee-49b5-9bb1-724e63d7309e TargetServiceName=null EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 ErrorCode=500 Ended create Csar for component NeutronPort 2021-04-14T11:08:56.718Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate" CURR_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Neutronport-template.yml,0,1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d6557bc0-faee-49b5-9bb1-724e63d7309e TargetServiceName=null EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 ErrorCode=500 lock resource with id 1f0a9fb4-5803-485c-9186-7a605af8de8d 2021-04-14T11:08:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c84183-33a2-4da7-9851-5088371eff9e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:08:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c84183-33a2-4da7-9851-5088371eff9e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@635ba4e1 2021-04-14T11:08:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c84183-33a2-4da7-9851-5088371eff9e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:08:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20c84183-33a2-4da7-9851-5088371eff9e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:08:58.615Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NeutronPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6aef98ed-9be9-4990-b73b-7407a979fe47" INVARIANT_UUID = "8400888c-81ed-4fdd-b6b8-0d2a947979a1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscacsar" CURR_ARTIFACT_UUID = "1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Neutronport-csar.csar,0,1f0a9fb4-5803-485c-9186-7a605af8de8d.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7678 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=828a75a0-351d-4b3e-b48e-6b905b1faa9e TargetServiceName=null EntryTimestamp=2021-04-14T11:08:50.936Z InvocationID=e37fc428-da01-41ff-805e-ff7276187a11 ErrorCode=500 LogTimestamp=2021-04-14T11:08:58.614463Z ResponseDesc=Created Exiting. 2021-04-14T11:08:58.615Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:08:58.688Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=378e7490-d73b-4a56-a468-ac6d8c7258ca InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:58.687986Z InvocationID=b79b33e2-0299-4473-a246-0a94a4aed22f LogTimestamp=2021-04-14T11:08:58.688080Z Entering 2021-04-14T11:08:58.688Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=378e7490-d73b-4a56-a468-ac6d8c7258ca InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:08:58.687986Z InvocationID=b79b33e2-0299-4473-a246-0a94a4aed22f LogTimestamp=2021-04-14T11:08:58.688080Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:08:59.176Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:59.176Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:59.176Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:59.176Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:08:59.176Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Novaserver 2021-04-14T11:09:00.004Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=20c84183-33a2-4da7-9851-5088371eff9e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:00.005Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=20c84183-33a2-4da7-9851-5088371eff9e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:00.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d390a156-fda4-45d6-9266-65b992b213bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:00.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d390a156-fda4-45d6-9266-65b992b213bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6866d1e5 2021-04-14T11:09:00.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d390a156-fda4-45d6-9266-65b992b213bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:00.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d390a156-fda4-45d6-9266-65b992b213bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:00.371Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.nova.Server" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f3a95c50-59c9-4f13-a880-fab7f2556820 EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:09:00.371Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.nova.Server" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f3a95c50-59c9-4f13-a880-fab7f2556820 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:09:00.642Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.nova.Server" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f3a95c50-59c9-4f13-a880-fab7f2556820 TargetServiceName=null EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 ErrorCode=500 lock resource with id 9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a 2021-04-14T11:09:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:09:02.238Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate" CURR_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Novaserver-template.yml,0,9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3f8a5788-7ae3-4ca7-ad6f-3e81d1a5b24d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 ErrorCode=500 Starting to create Csar for component NovaServer 2021-04-14T11:09:02.433Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate" CURR_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Novaserver-template.yml,0,9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3f8a5788-7ae3-4ca7-ad6f-3e81d1a5b24d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 ErrorCode=500 Ended create Csar for component NovaServer 2021-04-14T11:09:02.433Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate" CURR_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Novaserver-template.yml,0,9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3f8a5788-7ae3-4ca7-ad6f-3e81d1a5b24d TargetServiceName=null EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 ErrorCode=500 lock resource with id 9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a 2021-04-14T11:09:03.191Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d390a156-fda4-45d6-9266-65b992b213bc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:03.191Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d390a156-fda4-45d6-9266-65b992b213bc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:04.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86818fd-d546-4a0b-9ff6-c971546a3e49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:04.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86818fd-d546-4a0b-9ff6-c971546a3e49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ac95b7f 2021-04-14T11:09:04.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86818fd-d546-4a0b-9ff6-c971546a3e49 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:04.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c86818fd-d546-4a0b-9ff6-c971546a3e49 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:04.254Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NovaServer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f3a95c50-59c9-4f13-a880-fab7f2556820" INVARIANT_UUID = "68a141ba-4f04-46d9-9af9-beb693eb5ff1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscacsar" CURR_ARTIFACT_UUID = "9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Novaserver-csar.csar,0,9fbbca68-7ff8-42ac-8ca8-34a2bcbd110a.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=5566 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b213a6c7-f4b0-4a43-b914-3e3dd4ed6e9a TargetServiceName=null EntryTimestamp=2021-04-14T11:08:58.688Z InvocationID=bd1f122f-8eb0-4d01-908f-fe1e7c9d6ca7 ErrorCode=500 LogTimestamp=2021-04-14T11:09:04.254706Z ResponseDesc=Created Exiting. 2021-04-14T11:09:04.255Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:09:04.335Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c445f37d-6676-42fb-84e7-3e2c8cfe208e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:04.334997Z InvocationID=06928def-d43d-436f-9fc4-9b334801f947 LogTimestamp=2021-04-14T11:09:04.335077Z Entering 2021-04-14T11:09:04.335Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c445f37d-6676-42fb-84e7-3e2c8cfe208e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:04.334997Z InvocationID=06928def-d43d-436f-9fc4-9b334801f947 LogTimestamp=2021-04-14T11:09:04.335077Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:09:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:09:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:09:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:09:07.037Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c86818fd-d546-4a0b-9ff6-c971546a3e49 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:07.038Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c86818fd-d546-4a0b-9ff6-c971546a3e49 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:07.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b003b7-a35a-46e2-b35b-5d9de8b24525 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:07.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b003b7-a35a-46e2-b35b-5d9de8b24525 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f318192 2021-04-14T11:09:07.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b003b7-a35a-46e2-b35b-5d9de8b24525 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:07.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59b003b7-a35a-46e2-b35b-5d9de8b24525 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:08.433Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:08.433Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:08.433Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:08.433Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:08.534Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Extvl 2021-04-14T11:09:09.187Z [UEB-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServiceName=uebHealthCheck TargetServiceName=null ErrorCode=200 TargetEntity=uebHealthCheck ASDC Backend probably lost connectivity to UEB Cluster. Please check the logs for more information. 2021-04-14T11:09:10.896Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=59b003b7-a35a-46e2-b35b-5d9de8b24525 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:10.897Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=59b003b7-a35a-46e2-b35b-5d9de8b24525 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:12.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:12.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@577ddefb 2021-04-14T11:09:12.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:12.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:13.016Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.extVL" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8116035b-67c6-451b-ac61-448dd3407883 EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:09:13.017Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.extVL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8116035b-67c6-451b-ac61-448dd3407883 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:09:13.916Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.extVL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8116035b-67c6-451b-ac61-448dd3407883 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc ErrorCode=500 lock resource with id 8ed29469-64b9-4316-b77d-14c0c28ea77a 2021-04-14T11:09:15.225Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:15.225Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:15.226Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component DE state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:09:15.226Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a03e8fb2-5f51-41fc-9eb4-17abcc001dab ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:09:15.985Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate" CURR_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extvl-template.yml,0,8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cc01c687-ef58-4566-aa32-5c1214c453eb TargetServiceName=null EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc ErrorCode=500 Starting to create Csar for component ExtVL 2021-04-14T11:09:16.366Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate" CURR_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extvl-template.yml,0,8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cc01c687-ef58-4566-aa32-5c1214c453eb TargetServiceName=null EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc ErrorCode=500 Ended create Csar for component ExtVL 2021-04-14T11:09:16.366Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate" CURR_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extvl-template.yml,0,8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cc01c687-ef58-4566-aa32-5c1214c453eb TargetServiceName=null EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc ErrorCode=500 lock resource with id 8ed29469-64b9-4316-b77d-14c0c28ea77a 2021-04-14T11:09:16.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ca9def-d5d1-4af9-9e18-a717991cda6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:16.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ca9def-d5d1-4af9-9e18-a717991cda6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@318dbe84 2021-04-14T11:09:16.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ca9def-d5d1-4af9-9e18-a717991cda6c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:16.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23ca9def-d5d1-4af9-9e18-a717991cda6c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:18.404Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "8116035b-67c6-451b-ac61-448dd3407883" INVARIANT_UUID = "7478c177-c386-4dff-8e01-dd5d61266b11" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscacsar" CURR_ARTIFACT_UUID = "8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Extvl-csar.csar,0,8ed29469-64b9-4316-b77d-14c0c28ea77a.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14068 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=258fc9f2-32d9-4f89-a794-313e5a521e3c TargetServiceName=null EntryTimestamp=2021-04-14T11:09:04.335Z InvocationID=61175191-3044-4a46-9d38-19296bb22ccc ErrorCode=500 LogTimestamp=2021-04-14T11:09:18.403724Z ResponseDesc=Created Exiting. 2021-04-14T11:09:18.405Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:09:18.445Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2506c77b-58ab-4320-bc7f-64e59351d28f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:18.444718Z InvocationID=d6b693da-593f-46c0-b427-fce18e578efe LogTimestamp=2021-04-14T11:09:18.444788Z Entering 2021-04-14T11:09:18.445Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2506c77b-58ab-4320-bc7f-64e59351d28f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:18.444718Z InvocationID=d6b693da-593f-46c0-b427-fce18e578efe LogTimestamp=2021-04-14T11:09:18.444788Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:09:18.919Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:18.919Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:18.919Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:18.919Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:18.920Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Internalvl 2021-04-14T11:09:19.522Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=23ca9def-d5d1-4af9-9e18-a717991cda6c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:19.523Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=23ca9def-d5d1-4af9-9e18-a717991cda6c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:19.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92d54d8d-ce4d-4ebe-80e6-118fe70c8c90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:19.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92d54d8d-ce4d-4ebe-80e6-118fe70c8c90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74030341 2021-04-14T11:09:19.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92d54d8d-ce4d-4ebe-80e6-118fe70c8c90 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:19.766Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92d54d8d-ce4d-4ebe-80e6-118fe70c8c90 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:20.280Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.internalVL" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7969ac0c-e89a-472b-800b-4c7eb2ab81a9 EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:09:20.281Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.internalVL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7969ac0c-e89a-472b-800b-4c7eb2ab81a9 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:09:20.530Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.internalVL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7969ac0c-e89a-472b-800b-4c7eb2ab81a9 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 ErrorCode=500 lock resource with id 32a10f90-ea32-4a84-8187-b910663092d9 2021-04-14T11:09:22.108Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate" CURR_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Internalvl-template.yml,0,32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=21b49bf1-678e-4433-ae2f-f83fb253d9f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 ErrorCode=500 Starting to create Csar for component InternalVL 2021-04-14T11:09:22.309Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate" CURR_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Internalvl-template.yml,0,32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=21b49bf1-678e-4433-ae2f-f83fb253d9f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 ErrorCode=500 Ended create Csar for component InternalVL 2021-04-14T11:09:22.309Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate" CURR_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Internalvl-template.yml,0,32a10f90-ea32-4a84-8187-b910663092d9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=21b49bf1-678e-4433-ae2f-f83fb253d9f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 ErrorCode=500 lock resource with id 32a10f90-ea32-4a84-8187-b910663092d9 2021-04-14T11:09:22.776Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=92d54d8d-ce4d-4ebe-80e6-118fe70c8c90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:22.776Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=92d54d8d-ce4d-4ebe-80e6-118fe70c8c90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:23.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1952c6a-5ce1-40a7-86ed-88d084f77423 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:23.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1952c6a-5ce1-40a7-86ed-88d084f77423 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76699caf 2021-04-14T11:09:23.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1952c6a-5ce1-40a7-86ed-88d084f77423 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:23.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1952c6a-5ce1-40a7-86ed-88d084f77423 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:24.242Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "InternalVL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "7969ac0c-e89a-472b-800b-4c7eb2ab81a9" INVARIANT_UUID = "692e597c-5965-441d-a6f0-d347e5ad7fb3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscacsar" CURR_ARTIFACT_UUID = "32a10f90-ea32-4a84-8187-b910663092d9.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Internalvl-csar.csar,0,32a10f90-ea32-4a84-8187-b910663092d9.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=5796 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=00371fa7-6f06-4604-8332-3b3987246892 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:18.445Z InvocationID=2fa032b4-a161-4f06-867a-316ed7e7adb1 ErrorCode=500 LogTimestamp=2021-04-14T11:09:24.241744Z ResponseDesc=Created Exiting. 2021-04-14T11:09:24.242Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:09:24.347Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=963c11a6-11d1-44ea-92d7-e7d1d889f08e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:24.347547Z InvocationID=779864f2-14b3-4037-816a-4ae44b2752bb LogTimestamp=2021-04-14T11:09:24.347655Z Entering 2021-04-14T11:09:24.348Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=963c11a6-11d1-44ea-92d7-e7d1d889f08e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:24.347547Z InvocationID=779864f2-14b3-4037-816a-4ae44b2752bb LogTimestamp=2021-04-14T11:09:24.347655Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:09:26.625Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a1952c6a-5ce1-40a7-86ed-88d084f77423 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:26.626Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a1952c6a-5ce1-40a7-86ed-88d084f77423 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:27.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=911853d2-2680-43e0-acfe-b75bcf102e3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:27.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=911853d2-2680-43e0-acfe-b75bcf102e3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53d54180 2021-04-14T11:09:27.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=911853d2-2680-43e0-acfe-b75bcf102e3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:27.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=911853d2-2680-43e0-acfe-b75bcf102e3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:28.133Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:28.133Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:28.133Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:28.133Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:28.339Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Extcp 2021-04-14T11:09:30.697Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=911853d2-2680-43e0-acfe-b75bcf102e3f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:30.697Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=911853d2-2680-43e0-acfe-b75bcf102e3f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:31.620Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.extCP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a81e04a5-264b-46a8-98a3-99b4fa2a8fe9 EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:09:31.621Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.extCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a81e04a5-264b-46a8-98a3-99b4fa2a8fe9 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:09:31.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d392bd9-5908-4f78-a2aa-44d345018891 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:31.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d392bd9-5908-4f78-a2aa-44d345018891 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20910597 2021-04-14T11:09:31.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d392bd9-5908-4f78-a2aa-44d345018891 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:31.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d392bd9-5908-4f78-a2aa-44d345018891 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:33.018Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.extCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a81e04a5-264b-46a8-98a3-99b4fa2a8fe9 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 ErrorCode=500 lock resource with id e5791c53-fe7a-47d1-9c3f-8c03e68bfe91 2021-04-14T11:09:34.737Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7d392bd9-5908-4f78-a2aa-44d345018891 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:34.737Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7d392bd9-5908-4f78-a2aa-44d345018891 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:35.091Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate" CURR_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcp-template.yml,0,e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8b3ab356-4e80-482b-b35a-00c96ef40a7f TargetServiceName=null EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 ErrorCode=500 Starting to create Csar for component ExtCP 2021-04-14T11:09:35.293Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate" CURR_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcp-template.yml,0,e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8b3ab356-4e80-482b-b35a-00c96ef40a7f TargetServiceName=null EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 ErrorCode=500 Ended create Csar for component ExtCP 2021-04-14T11:09:35.293Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate" CURR_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcp-template.yml,0,e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8b3ab356-4e80-482b-b35a-00c96ef40a7f TargetServiceName=null EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 ErrorCode=500 lock resource with id e5791c53-fe7a-47d1-9c3f-8c03e68bfe91 2021-04-14T11:09:35.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b73a60fd-5e01-4507-9d8e-ba6602fae77f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:35.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b73a60fd-5e01-4507-9d8e-ba6602fae77f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@648d3f6b 2021-04-14T11:09:35.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b73a60fd-5e01-4507-9d8e-ba6602fae77f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:35.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b73a60fd-5e01-4507-9d8e-ba6602fae77f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:37.107Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "a81e04a5-264b-46a8-98a3-99b4fa2a8fe9" INVARIANT_UUID = "3739a3ec-887c-4e95-b888-8ede75381275" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscacsar" CURR_ARTIFACT_UUID = "e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Extcp-csar.csar,0,e5791c53-fe7a-47d1-9c3f-8c03e68bfe91.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=12759 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=559a75cc-2f26-488d-b396-1fc31ba2033b TargetServiceName=null EntryTimestamp=2021-04-14T11:09:24.348Z InvocationID=8ebfb3a7-a8d2-4570-9400-4eb222d18106 ErrorCode=500 LogTimestamp=2021-04-14T11:09:37.107128Z ResponseDesc=Created Exiting. 2021-04-14T11:09:37.108Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:09:37.187Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0fbcfe88-90b9-40b5-b361-bf9c33c7d7ec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:37.186985Z InvocationID=934876d1-2ff0-4ac9-9c55-7e100e711ae8 LogTimestamp=2021-04-14T11:09:37.187041Z Entering 2021-04-14T11:09:37.187Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0fbcfe88-90b9-40b5-b361-bf9c33c7d7ec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:37.186985Z InvocationID=934876d1-2ff0-4ac9-9c55-7e100e711ae8 LogTimestamp=2021-04-14T11:09:37.187041Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:09:38.102Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:38.102Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:38.102Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:38.102Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:38.302Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Vl 2021-04-14T11:09:38.407Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b73a60fd-5e01-4507-9d8e-ba6602fae77f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:38.408Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b73a60fd-5e01-4507-9d8e-ba6602fae77f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:39.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c069e58-f350-45e1-baa1-2810ef341bcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:39.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c069e58-f350-45e1-baa1-2810ef341bcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6deac659 2021-04-14T11:09:39.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c069e58-f350-45e1-baa1-2810ef341bcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:39.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c069e58-f350-45e1-baa1-2810ef341bcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:39.829Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.VL" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e56a8f93-4983-4ad5-aefc-65173e86b13c EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:09:39.830Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.VL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e56a8f93-4983-4ad5-aefc-65173e86b13c TargetServiceName=null EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:09:40.157Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.VL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e56a8f93-4983-4ad5-aefc-65173e86b13c TargetServiceName=null EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 ErrorCode=500 lock resource with id d64cbfc4-3335-43f5-b346-415f2091302b 2021-04-14T11:09:41.751Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate" CURR_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vl-template.yml,0,d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9837e20a-4d5e-4812-8e68-40d159ef2e52 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 ErrorCode=500 Starting to create Csar for component VL 2021-04-14T11:09:41.968Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate" CURR_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vl-template.yml,0,d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9837e20a-4d5e-4812-8e68-40d159ef2e52 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 ErrorCode=500 Ended create Csar for component VL 2021-04-14T11:09:41.969Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate" CURR_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vl-template.yml,0,d64cbfc4-3335-43f5-b346-415f2091302b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9837e20a-4d5e-4812-8e68-40d159ef2e52 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 ErrorCode=500 lock resource with id d64cbfc4-3335-43f5-b346-415f2091302b 2021-04-14T11:09:42.110Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2c069e58-f350-45e1-baa1-2810ef341bcb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:42.111Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2c069e58-f350-45e1-baa1-2810ef341bcb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:42.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06352f5-1cb7-4167-948d-c71fc768a7b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:42.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06352f5-1cb7-4167-948d-c71fc768a7b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10ec0809 2021-04-14T11:09:42.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06352f5-1cb7-4167-948d-c71fc768a7b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:42.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06352f5-1cb7-4167-948d-c71fc768a7b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:43.738Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "e56a8f93-4983-4ad5-aefc-65173e86b13c" INVARIANT_UUID = "7f85eb0d-5d58-4655-a585-875bfafed0af" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscacsar" CURR_ARTIFACT_UUID = "d64cbfc4-3335-43f5-b346-415f2091302b.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Vl-csar.csar,0,d64cbfc4-3335-43f5-b346-415f2091302b.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6549 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=26d7be11-60d1-4a95-9b6c-6263750a2b95 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:37.188Z InvocationID=4efadb57-1665-402d-897a-f20fc2bf95b9 ErrorCode=500 LogTimestamp=2021-04-14T11:09:43.737846Z ResponseDesc=Created Exiting. 2021-04-14T11:09:43.738Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:09:43.753Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f9653b8b-f9f0-4c4c-aec9-a3ece82a7412 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:43.753694Z InvocationID=7f4fdd10-a4a8-43a7-bc43-53aa55ac683b LogTimestamp=2021-04-14T11:09:43.753741Z Entering 2021-04-14T11:09:43.754Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f9653b8b-f9f0-4c4c-aec9-a3ece82a7412 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:43.753694Z InvocationID=7f4fdd10-a4a8-43a7-bc43-53aa55ac683b LogTimestamp=2021-04-14T11:09:43.753741Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:09:45.128Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:45.128Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:45.128Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:45.128Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:45.241Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VlEline 2021-04-14T11:09:45.442Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f06352f5-1cb7-4167-948d-c71fc768a7b3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:45.443Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f06352f5-1cb7-4167-948d-c71fc768a7b3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0c1d86-699a-40ac-8999-02952ad695bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0c1d86-699a-40ac-8999-02952ad695bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@103d6e4a 2021-04-14T11:09:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0c1d86-699a-40ac-8999-02952ad695bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf0c1d86-699a-40ac-8999-02952ad695bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:49.393Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bf0c1d86-699a-40ac-8999-02952ad695bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:49.394Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bf0c1d86-699a-40ac-8999-02952ad695bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:50.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c9cd595-02cc-4847-b572-aa3be104ac50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:50.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c9cd595-02cc-4847-b572-aa3be104ac50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4506762a 2021-04-14T11:09:50.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c9cd595-02cc-4847-b572-aa3be104ac50 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:50.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c9cd595-02cc-4847-b572-aa3be104ac50 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:50.936Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.ELine" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=67e3b0ea-2502-41af-b7ed-3dda4452c7e2 EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:09:50.937Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.ELine" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=67e3b0ea-2502-41af-b7ed-3dda4452c7e2 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:09:52.315Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.ELine" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=67e3b0ea-2502-41af-b7ed-3dda4452c7e2 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 ErrorCode=500 lock resource with id 677d6e33-98fb-4979-aecd-80b4b8cc609b 2021-04-14T11:09:53.440Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9c9cd595-02cc-4847-b572-aa3be104ac50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:53.440Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9c9cd595-02cc-4847-b572-aa3be104ac50 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:54.238Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate" CURR_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlEline-template.yml,0,677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=05583e83-9f1e-4ea8-b7f2-403941666469 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 ErrorCode=500 Starting to create Csar for component VL ELINE 2021-04-14T11:09:54.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93649b33-cf72-45cb-b607-50595ebd3c44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:54.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93649b33-cf72-45cb-b607-50595ebd3c44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60d92478 2021-04-14T11:09:54.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93649b33-cf72-45cb-b607-50595ebd3c44 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:54.432Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93649b33-cf72-45cb-b607-50595ebd3c44 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:54.501Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate" CURR_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlEline-template.yml,0,677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=05583e83-9f1e-4ea8-b7f2-403941666469 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 ErrorCode=500 Ended create Csar for component VL ELINE 2021-04-14T11:09:54.501Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate" CURR_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlEline-template.yml,0,677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=05583e83-9f1e-4ea8-b7f2-403941666469 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 ErrorCode=500 lock resource with id 677d6e33-98fb-4979-aecd-80b4b8cc609b 2021-04-14T11:09:56.310Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL ELINE" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "67e3b0ea-2502-41af-b7ed-3dda4452c7e2" INVARIANT_UUID = "a2742973-6cd1-46cf-9f31-a1c8d8d69094" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscacsar" CURR_ARTIFACT_UUID = "677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VlEline-csar.csar,0,677d6e33-98fb-4979-aecd-80b4b8cc609b.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=12556 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=874aa0f0-1059-4d8c-aecc-3eb3b99157d3 TargetServiceName=null EntryTimestamp=2021-04-14T11:09:43.754Z InvocationID=6ab59c7b-ecde-4237-8163-feaf989d2f45 ErrorCode=500 LogTimestamp=2021-04-14T11:09:56.310094Z ResponseDesc=Created Exiting. 2021-04-14T11:09:56.314Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:09:56.329Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=134f5d58-5025-411a-90f9-3f1ab2326b6d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:56.329673Z InvocationID=65ba0754-335c-4e85-b5d9-c330b80eff0b LogTimestamp=2021-04-14T11:09:56.329752Z Entering 2021-04-14T11:09:56.330Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=134f5d58-5025-411a-90f9-3f1ab2326b6d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:09:56.329673Z InvocationID=65ba0754-335c-4e85-b5d9-c330b80eff0b LogTimestamp=2021-04-14T11:09:56.329752Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:09:57.203Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:57.204Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:57.204Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:57.204Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:09:57.204Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Abstractsubstitute 2021-04-14T11:09:57.445Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=93649b33-cf72-45cb-b607-50595ebd3c44 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:09:57.445Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=93649b33-cf72-45cb-b607-50595ebd3c44 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:09:58.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=694b4245-b718-406c-bd2b-3d11191dba65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:09:58.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=694b4245-b718-406c-bd2b-3d11191dba65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77c5c94b 2021-04-14T11:09:58.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=694b4245-b718-406c-bd2b-3d11191dba65 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:09:58.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=694b4245-b718-406c-bd2b-3d11191dba65 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:09:59.365Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "AbstractSubstitute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "e587275a-0573-4b1b-9a75-178597318c4b" INVARIANT_UUID = "b4a0797e-552c-4ddd-8f00-c551d9154991" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.AbstractSubstitute" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e587275a-0573-4b1b-9a75-178597318c4b EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id aa39365e-9709-49de-8098-e8cecc33d70b 2021-04-14T11:10:00.955Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "AbstractSubstitute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "e587275a-0573-4b1b-9a75-178597318c4b" INVARIANT_UUID = "b4a0797e-552c-4ddd-8f00-c551d9154991" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "aa39365e-9709-49de-8098-e8cecc33d70b.assettoscatemplate" CURR_ARTIFACT_UUID = "aa39365e-9709-49de-8098-e8cecc33d70b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Abstractsubstitute-template.yml,0,aa39365e-9709-49de-8098-e8cecc33d70b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=4624 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f3327db6-e693-4297-8723-d1c55c35b907 EntryTimestamp=2021-04-14T11:09:56.330Z InvocationID=267402d2-839d-4bed-9e5f-b46ca1912291 LogTimestamp=2021-04-14T11:10:00.954826Z ResponseDesc=Created Exiting. 2021-04-14T11:10:00.956Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:00.970Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d79d0d73-f36f-4e00-99bf-662231d7bf1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:00.969837Z InvocationID=c7ded56a-4694-4aac-8ce9-7a3dc4e5b547 LogTimestamp=2021-04-14T11:10:00.969879Z Entering 2021-04-14T11:10:00.970Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d79d0d73-f36f-4e00-99bf-662231d7bf1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:00.969837Z InvocationID=c7ded56a-4694-4aac-8ce9-7a3dc4e5b547 LogTimestamp=2021-04-14T11:10:00.969879Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:01.199Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:01.199Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:01.199Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:01.199Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:01.199Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name GenericVfc 2021-04-14T11:10:01.210Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=694b4245-b718-406c-bd2b-3d11191dba65 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:01.210Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=694b4245-b718-406c-bd2b-3d11191dba65 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:01.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d2eba39-0952-4462-8a87-57844f8239b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:01.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d2eba39-0952-4462-8a87-57844f8239b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f39d94d 2021-04-14T11:10:01.354Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d2eba39-0952-4462-8a87-57844f8239b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:01.355Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d2eba39-0952-4462-8a87-57844f8239b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:03.025Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic_VFC" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "68527eba-99ff-4454-b030-d16da88951ef" INVARIANT_UUID = "d9a1f3f1-4d9e-405c-bae6-1036e47ec2ea" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.VFC" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=68527eba-99ff-4454-b030-d16da88951ef EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id d4d8ef39-0c73-4979-9d97-ba1dc09d7034 2021-04-14T11:10:04.366Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2d2eba39-0952-4462-8a87-57844f8239b3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:04.366Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2d2eba39-0952-4462-8a87-57844f8239b3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:05.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afebf4ca-339a-4b36-b943-7f3114929b03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afebf4ca-339a-4b36-b943-7f3114929b03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@550b646c 2021-04-14T11:10:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afebf4ca-339a-4b36-b943-7f3114929b03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:05.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afebf4ca-339a-4b36-b943-7f3114929b03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:05.140Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic_VFC" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "68527eba-99ff-4454-b030-d16da88951ef" INVARIANT_UUID = "d9a1f3f1-4d9e-405c-bae6-1036e47ec2ea" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d4d8ef39-0c73-4979-9d97-ba1dc09d7034.assettoscatemplate" CURR_ARTIFACT_UUID = "d4d8ef39-0c73-4979-9d97-ba1dc09d7034.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericVfc-template.yml,0,d4d8ef39-0c73-4979-9d97-ba1dc09d7034.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=4169 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=18979eec-0bdf-4526-b6fc-cc9a9993daa8 EntryTimestamp=2021-04-14T11:10:00.970Z InvocationID=00722ecf-685e-40d1-9ad9-d7bebb7dc48c LogTimestamp=2021-04-14T11:10:05.139962Z ResponseDesc=Created Exiting. 2021-04-14T11:10:05.140Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:05.232Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3fc1bd91-9cd7-4bd3-ae34-85f3a27c4d27 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:05.232056Z InvocationID=7499a9ef-5b2a-457c-b2a5-c3ef1db74bbd LogTimestamp=2021-04-14T11:10:05.232142Z Entering 2021-04-14T11:10:05.232Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3fc1bd91-9cd7-4bd3-ae34-85f3a27c4d27 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:05.232056Z InvocationID=7499a9ef-5b2a-457c-b2a5-c3ef1db74bbd LogTimestamp=2021-04-14T11:10:05.232142Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:08.128Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=afebf4ca-339a-4b36-b943-7f3114929b03 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:08.129Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=afebf4ca-339a-4b36-b943-7f3114929b03 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:09.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d59d21-d98d-47e3-addf-e6d3c920f12d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d59d21-d98d-47e3-addf-e6d3c920f12d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@649b592b 2021-04-14T11:10:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d59d21-d98d-47e3-addf-e6d3c920f12d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7d59d21-d98d-47e3-addf-e6d3c920f12d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:09.812Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:09.812Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:09.812Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:09.812Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:09.812Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name GenericVf 2021-04-14T11:10:12.153Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b7d59d21-d98d-47e3-addf-e6d3c920f12d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:12.154Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b7d59d21-d98d-47e3-addf-e6d3c920f12d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:12.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d4e6eac-6a01-49ed-85dc-01a00ee34446 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:12.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d4e6eac-6a01-49ed-85dc-01a00ee34446 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d5e7e01 2021-04-14T11:10:12.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d4e6eac-6a01-49ed-85dc-01a00ee34446 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:12.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d4e6eac-6a01-49ed-85dc-01a00ee34446 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:12.956Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic_VF" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "628d0fe9-18f9-41b6-a92a-d589e688b637" INVARIANT_UUID = "91d53725-b48b-44d0-8b77-3ea29d98b21c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.VF" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=628d0fe9-18f9-41b6-a92a-d589e688b637 EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 1cae895b-b882-4286-afcc-2d6fc860cf10 2021-04-14T11:10:14.820Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic_VF" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "628d0fe9-18f9-41b6-a92a-d589e688b637" INVARIANT_UUID = "91d53725-b48b-44d0-8b77-3ea29d98b21c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1cae895b-b882-4286-afcc-2d6fc860cf10.assettoscatemplate" CURR_ARTIFACT_UUID = "1cae895b-b882-4286-afcc-2d6fc860cf10.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericVf-template.yml,0,1cae895b-b882-4286-afcc-2d6fc860cf10.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=9587 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0b58db78-512c-4b06-90ad-0147a2312f66 EntryTimestamp=2021-04-14T11:10:05.232Z InvocationID=7f176212-4cea-4cfd-8493-e0db1af9e104 LogTimestamp=2021-04-14T11:10:14.819971Z ResponseDesc=Created Exiting. 2021-04-14T11:10:14.821Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:14.894Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9d2e60c1-bba6-4761-aa72-d2d2f724bcd1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:14.893861Z InvocationID=6ca1b20c-2ded-4b52-98a4-6958e1cc9577 LogTimestamp=2021-04-14T11:10:14.893918Z Entering 2021-04-14T11:10:14.894Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9d2e60c1-bba6-4761-aa72-d2d2f724bcd1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:14.893861Z InvocationID=6ca1b20c-2ded-4b52-98a4-6958e1cc9577 LogTimestamp=2021-04-14T11:10:14.893918Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:15.791Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:15.791Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:15.791Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:15.791Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:15.791Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name GenericCr 2021-04-14T11:10:15.829Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2d4e6eac-6a01-49ed-85dc-01a00ee34446 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:15.830Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2d4e6eac-6a01-49ed-85dc-01a00ee34446 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:16.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e441a55-d01a-40bf-be92-0723b0dd5f07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:16.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e441a55-d01a-40bf-be92-0723b0dd5f07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7eadddd5 2021-04-14T11:10:16.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e441a55-d01a-40bf-be92-0723b0dd5f07 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:16.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e441a55-d01a-40bf-be92-0723b0dd5f07 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:18.293Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic_CR" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "38b92afb-3e5c-41cc-9518-5b8be5de0527" INVARIANT_UUID = "908aaf87-266d-4be3-bd6c-35e631190901" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.CR" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=38b92afb-3e5c-41cc-9518-5b8be5de0527 EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id e8babc4b-4914-43d7-bc6d-1c62124c49eb 2021-04-14T11:10:19.610Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3e441a55-d01a-40bf-be92-0723b0dd5f07 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:19.610Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3e441a55-d01a-40bf-be92-0723b0dd5f07 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:19.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e04ba65-1956-49a1-880a-30e672c59804 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:19.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e04ba65-1956-49a1-880a-30e672c59804 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41541773 2021-04-14T11:10:19.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e04ba65-1956-49a1-880a-30e672c59804 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:19.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e04ba65-1956-49a1-880a-30e672c59804 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:19.948Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic_CR" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "38b92afb-3e5c-41cc-9518-5b8be5de0527" INVARIANT_UUID = "908aaf87-266d-4be3-bd6c-35e631190901" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e8babc4b-4914-43d7-bc6d-1c62124c49eb.assettoscatemplate" CURR_ARTIFACT_UUID = "e8babc4b-4914-43d7-bc6d-1c62124c49eb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericCr-template.yml,0,e8babc4b-4914-43d7-bc6d-1c62124c49eb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=5052 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cf598a51-dd8e-4032-abe3-a5ba07b7152e EntryTimestamp=2021-04-14T11:10:14.895Z InvocationID=47aac966-aaee-4b9b-b257-8617a3487916 LogTimestamp=2021-04-14T11:10:19.947986Z ResponseDesc=Created Exiting. 2021-04-14T11:10:19.948Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:19.983Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=815d5455-42b2-4fed-b6ec-b3d07a674f38 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:19.983417Z InvocationID=344b4383-ccb8-4d5f-ae7d-45ad0289ea5b LogTimestamp=2021-04-14T11:10:19.983456Z Entering 2021-04-14T11:10:19.983Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=815d5455-42b2-4fed-b6ec-b3d07a674f38 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:19.983417Z InvocationID=344b4383-ccb8-4d5f-ae7d-45ad0289ea5b LogTimestamp=2021-04-14T11:10:19.983456Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:20.165Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:20.165Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:20.165Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:20.165Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:20.165Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name GenericPnf 2021-04-14T11:10:21.509Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic_PNF" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "830ad273-2713-44bd-8c74-a567f97cb353" INVARIANT_UUID = "39d69e58-799a-4064-b4ad-3776b4fe874a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.PNF" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=830ad273-2713-44bd-8c74-a567f97cb353 EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id a7cb9b4c-7f55-477e-a2a8-faa74e8e6118 2021-04-14T11:10:22.872Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3e04ba65-1956-49a1-880a-30e672c59804 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:22.872Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3e04ba65-1956-49a1-880a-30e672c59804 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:23.230Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic_PNF" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "830ad273-2713-44bd-8c74-a567f97cb353" INVARIANT_UUID = "39d69e58-799a-4064-b4ad-3776b4fe874a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a7cb9b4c-7f55-477e-a2a8-faa74e8e6118.assettoscatemplate" CURR_ARTIFACT_UUID = "a7cb9b4c-7f55-477e-a2a8-faa74e8e6118.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericPnf-template.yml,0,a7cb9b4c-7f55-477e-a2a8-faa74e8e6118.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=3247 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=41bfdb3b-72e7-4841-ba37-8fd70e6a1801 EntryTimestamp=2021-04-14T11:10:19.983Z InvocationID=c3079299-18a5-4d00-a3dc-8678b958ebd2 LogTimestamp=2021-04-14T11:10:23.230693Z ResponseDesc=Created Exiting. 2021-04-14T11:10:23.231Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:23.317Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9f1b1554-8cad-4d1d-9215-2296be35e0c1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:23.317051Z InvocationID=c8cbd138-05d7-48e0-ad9f-375ab4ffd7bd LogTimestamp=2021-04-14T11:10:23.317131Z Entering 2021-04-14T11:10:23.317Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9f1b1554-8cad-4d1d-9215-2296be35e0c1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:23.317051Z InvocationID=c8cbd138-05d7-48e0-ad9f-375ab4ffd7bd LogTimestamp=2021-04-14T11:10:23.317131Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:23.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a6704f2-a399-41e8-93d6-02f21c8d3e62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:23.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a6704f2-a399-41e8-93d6-02f21c8d3e62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d3de08d 2021-04-14T11:10:23.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a6704f2-a399-41e8-93d6-02f21c8d3e62 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:23.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a6704f2-a399-41e8-93d6-02f21c8d3e62 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:24.341Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:24.343Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:24.343Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:24.343Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:24.343Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name GenericService 2021-04-14T11:10:26.725Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9a6704f2-a399-41e8-93d6-02f21c8d3e62 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:26.725Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9a6704f2-a399-41e8-93d6-02f21c8d3e62 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e6b169-85ff-4e32-a0df-6663fd7f66a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e6b169-85ff-4e32-a0df-6663fd7f66a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65e92856 2021-04-14T11:10:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e6b169-85ff-4e32-a0df-6663fd7f66a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:27.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e6b169-85ff-4e32-a0df-6663fd7f66a7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:29.085Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond 2021-04-14T11:10:29.085Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:30.542Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic_Service" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "09910978-8ab7-4676-85fe-ceffcd38b0d1" INVARIANT_UUID = "d9479b83-0cbb-4b62-9a0a-a078a709ed9b" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.service" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=09910978-8ab7-4676-85fe-ceffcd38b0d1 EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id a2843be4-68fd-42f2-90f3-1e4cabce32e0 2021-04-14T11:10:30.601Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=30e6b169-85ff-4e32-a0df-6663fd7f66a7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:30.601Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=30e6b169-85ff-4e32-a0df-6663fd7f66a7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:31.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7c4e31-f142-4727-a41e-6a7ee208b359 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:31.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7c4e31-f142-4727-a41e-6a7ee208b359 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c8b9371 2021-04-14T11:10:31.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7c4e31-f142-4727-a41e-6a7ee208b359 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:31.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7c4e31-f142-4727-a41e-6a7ee208b359 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:32.528Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic_Service" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "09910978-8ab7-4676-85fe-ceffcd38b0d1" INVARIANT_UUID = "d9479b83-0cbb-4b62-9a0a-a078a709ed9b" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a2843be4-68fd-42f2-90f3-1e4cabce32e0.assettoscatemplate" CURR_ARTIFACT_UUID = "a2843be4-68fd-42f2-90f3-1e4cabce32e0.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericService-template.yml,0,a2843be4-68fd-42f2-90f3-1e4cabce32e0.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=9209 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ee310cd1-5beb-4e5c-bec9-dbb28320f25c EntryTimestamp=2021-04-14T11:10:23.318Z InvocationID=0b7ac0e2-0f52-4056-bbeb-473b019b6ee6 LogTimestamp=2021-04-14T11:10:32.527801Z ResponseDesc=Created Exiting. 2021-04-14T11:10:32.529Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:32.619Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3d01856f-8950-4523-8082-a0d5dd9d484c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:32.619301Z InvocationID=28924ce6-47b4-4c2b-88e4-ea4981712566 LogTimestamp=2021-04-14T11:10:32.619377Z Entering 2021-04-14T11:10:32.619Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3d01856f-8950-4523-8082-a0d5dd9d484c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:32.619301Z InvocationID=28924ce6-47b4-4c2b-88e4-ea4981712566 LogTimestamp=2021-04-14T11:10:32.619377Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:33.340Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:33.340Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:33.340Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:33.340Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:33.420Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailnetworkrules 2021-04-14T11:10:34.236Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=db7c4e31-f142-4727-a41e-6a7ee208b359 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:34.237Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=db7c4e31-f142-4727-a41e-6a7ee208b359 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:34.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03105c31-95ca-4fc5-8342-2f977910940b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:34.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03105c31-95ca-4fc5-8342-2f977910940b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e14f922 2021-04-14T11:10:34.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03105c31-95ca-4fc5-8342-2f977910940b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:34.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03105c31-95ca-4fc5-8342-2f977910940b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:34.802Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.contrail.NetworkRules" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8cb4a7bb-3226-4a33-8fe0-3b8fedf78076 EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:10:34.804Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.contrail.NetworkRules" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8cb4a7bb-3226-4a33-8fe0-3b8fedf78076 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:10:35.641Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.contrail.NetworkRules" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8cb4a7bb-3226-4a33-8fe0-3b8fedf78076 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 ErrorCode=500 lock resource with id 8097ca1b-dc26-42ea-9475-d7bb31e5610b 2021-04-14T11:10:35.854Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:35.854Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:35.879Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:35.879Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.183Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.183Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.183Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.184Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.193Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:36.194Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:10:36.194Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:10:36.195Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:10:36.195Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:10:36.196Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:10:36.196Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:10:36.209Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.209Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.216Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond 2021-04-14T11:10:36.216Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.217Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.217Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.224Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:36.225Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.225Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.229Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:36.236Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:36.237Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:10:36.237Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:10:36.237Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.237Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.241Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.241Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.247Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.247Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.254Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:36.256Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:36.261Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.261Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.273Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.273Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.281Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:36.281Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:36.286Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:36.289Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:37.596Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate" CURR_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailnetworkrules-template.yml,0,8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a861af16-9027-4500-b4ee-1e28a8b46288 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 ErrorCode=500 Starting to create Csar for component ContrailNetworkRules 2021-04-14T11:10:37.597Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=03105c31-95ca-4fc5-8342-2f977910940b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:37.597Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=03105c31-95ca-4fc5-8342-2f977910940b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:37.819Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate" CURR_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailnetworkrules-template.yml,0,8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a861af16-9027-4500-b4ee-1e28a8b46288 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 ErrorCode=500 Ended create Csar for component ContrailNetworkRules 2021-04-14T11:10:37.820Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate" CURR_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailnetworkrules-template.yml,0,8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a861af16-9027-4500-b4ee-1e28a8b46288 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 ErrorCode=500 lock resource with id 8097ca1b-dc26-42ea-9475-d7bb31e5610b 2021-04-14T11:10:38.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0167b3a1-94e6-4216-a3bf-0699186c6347 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:38.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0167b3a1-94e6-4216-a3bf-0699186c6347 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51e67ddf 2021-04-14T11:10:38.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0167b3a1-94e6-4216-a3bf-0699186c6347 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:38.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0167b3a1-94e6-4216-a3bf-0699186c6347 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:38.917Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.917Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.924Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.924Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.933Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.933Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.936Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:38.938Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:38.940Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.940Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.944Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.944Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.948Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.948Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.953Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:38.954Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:38.957Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.957Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.964Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.964Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.968Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.968Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.973Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:38.974Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:38.976Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.976Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.980Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.980Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.984Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.984Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:38.991Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:38.994Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:38.997Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:38.997Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.000Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.000Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.005Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.005Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.014Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:39.015Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:39.022Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.022Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.038Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.038Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.048Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.048Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.052Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:39.055Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:39.060Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.060Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.064Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.064Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.069Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.069Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.072Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:39.074Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:39.080Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.080Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.084Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.084Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.088Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.088Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.092Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:39.093Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:39.097Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.097Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.100Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.100Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.105Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.105Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.113Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:10:39.114Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:10:39.117Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.117Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.129Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.129Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.133Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:10:39.133Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:10:39.576Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailNetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "8cb4a7bb-3226-4a33-8fe0-3b8fedf78076" INVARIANT_UUID = "d4bc331c-8deb-4271-b031-d4190bb54d59" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscacsar" CURR_ARTIFACT_UUID = "8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailnetworkrules-csar.csar,0,8097ca1b-dc26-42ea-9475-d7bb31e5610b.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6955 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8166f7af-7ee5-4061-b7ff-fa80dde60739 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:32.620Z InvocationID=0228a98d-b1dc-4aba-a6a4-163bf80a6db9 ErrorCode=500 LogTimestamp=2021-04-14T11:10:39.575619Z ResponseDesc=Created Exiting. 2021-04-14T11:10:39.576Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:39.774Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0c9e9b04-57ca-4e27-9748-1c5dafa132b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:39.774416Z InvocationID=b408d229-787e-48c2-9843-cbe5f0b46131 LogTimestamp=2021-04-14T11:10:39.774462Z Entering 2021-04-14T11:10:39.775Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0c9e9b04-57ca-4e27-9748-1c5dafa132b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:39.774416Z InvocationID=b408d229-787e-48c2-9843-cbe5f0b46131 LogTimestamp=2021-04-14T11:10:39.774462Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:39.988Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:39.988Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:39.988Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:39.988Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:39.988Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailport 2021-04-14T11:10:41.196Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0167b3a1-94e6-4216-a3bf-0699186c6347 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:41.197Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0167b3a1-94e6-4216-a3bf-0699186c6347 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:41.262Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.contrail.Port" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4fba0047-1b42-4f5f-b6cc-196a1bd328b5 EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:10:41.262Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.contrail.Port" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4fba0047-1b42-4f5f-b6cc-196a1bd328b5 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:10:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e0b794c-3c62-450c-91c0-ba2aaf534bf3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e0b794c-3c62-450c-91c0-ba2aaf534bf3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44387601 2021-04-14T11:10:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e0b794c-3c62-450c-91c0-ba2aaf534bf3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:41.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e0b794c-3c62-450c-91c0-ba2aaf534bf3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:41.631Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.contrail.Port" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4fba0047-1b42-4f5f-b6cc-196a1bd328b5 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 ErrorCode=500 lock resource with id 3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe 2021-04-14T11:10:43.331Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate" CURR_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailport-template.yml,0,3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ae8ac5a7-8322-454e-9983-e08e79b5ab59 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 ErrorCode=500 Starting to create Csar for component ContrailPort 2021-04-14T11:10:43.514Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate" CURR_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailport-template.yml,0,3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ae8ac5a7-8322-454e-9983-e08e79b5ab59 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 ErrorCode=500 Ended create Csar for component ContrailPort 2021-04-14T11:10:43.515Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate" CURR_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailport-template.yml,0,3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ae8ac5a7-8322-454e-9983-e08e79b5ab59 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 ErrorCode=500 lock resource with id 3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe 2021-04-14T11:10:44.569Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8e0b794c-3c62-450c-91c0-ba2aaf534bf3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:44.570Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8e0b794c-3c62-450c-91c0-ba2aaf534bf3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:45.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b732eef2-cf0a-4b6b-ae03-6e769904ed51 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:45.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b732eef2-cf0a-4b6b-ae03-6e769904ed51 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7492711c 2021-04-14T11:10:45.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b732eef2-cf0a-4b6b-ae03-6e769904ed51 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:45.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b732eef2-cf0a-4b6b-ae03-6e769904ed51 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:45.920Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailPort" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4fba0047-1b42-4f5f-b6cc-196a1bd328b5" INVARIANT_UUID = "e9d79afd-665c-4323-b854-c878749224e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscacsar" CURR_ARTIFACT_UUID = "3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailport-csar.csar,0,3cfb5044-f0b8-42a5-a9a0-f4dddb38edfe.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6145 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4638bbe1-c275-47c0-9fe7-c063c4600516 TargetServiceName=null EntryTimestamp=2021-04-14T11:10:39.775Z InvocationID=e999611f-43af-4aee-875c-4a43e5934e92 ErrorCode=500 LogTimestamp=2021-04-14T11:10:45.920110Z ResponseDesc=Created Exiting. 2021-04-14T11:10:45.920Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:46.015Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=98eb6e95-d2d5-4a5d-875b-9553bca8677f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:46.015345Z InvocationID=05f775d9-c69e-4bbe-99df-c7bfe1d2c98c LogTimestamp=2021-04-14T11:10:46.015405Z Entering 2021-04-14T11:10:46.016Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=98eb6e95-d2d5-4a5d-875b-9553bca8677f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:46.015345Z InvocationID=05f775d9-c69e-4bbe-99df-c7bfe1d2c98c LogTimestamp=2021-04-14T11:10:46.015405Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:48.440Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b732eef2-cf0a-4b6b-ae03-6e769904ed51 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:48.441Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b732eef2-cf0a-4b6b-ae03-6e769904ed51 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:49.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc932ee-c67d-4ab7-973b-5aa6ada3576d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:49.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc932ee-c67d-4ab7-973b-5aa6ada3576d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cd5865e 2021-04-14T11:10:49.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc932ee-c67d-4ab7-973b-5aa6ada3576d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:49.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc932ee-c67d-4ab7-973b-5aa6ada3576d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:49.713Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:49.713Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:49.713Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:49.713Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:49.830Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name PortMirroringConfiguration 2021-04-14T11:10:52.244Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3bc932ee-c67d-4ab7-973b-5aa6ada3576d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:52.244Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3bc932ee-c67d-4ab7-973b-5aa6ada3576d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:52.835Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Port Mirroring Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "01aa96e7-924b-4be4-8f6e-b8ab89efb0ae" INVARIANT_UUID = "aad6bbbf-138d-4c0a-9980-585cabf49999" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.PortMirroringConfiguration" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=01aa96e7-924b-4be4-8f6e-b8ab89efb0ae EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 674fed49-d968-458e-9323-8586ef53275f 2021-04-14T11:10:53.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984e0787-eb0b-4c74-b2a5-75bebb1ff732 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:53.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984e0787-eb0b-4c74-b2a5-75bebb1ff732 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a75ad57 2021-04-14T11:10:53.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984e0787-eb0b-4c74-b2a5-75bebb1ff732 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:53.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=984e0787-eb0b-4c74-b2a5-75bebb1ff732 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:54.606Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "01aa96e7-924b-4be4-8f6e-b8ab89efb0ae" INVARIANT_UUID = "aad6bbbf-138d-4c0a-9980-585cabf49999" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate" CURR_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-PortMirroringConfiguration-template.yml,0,674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a93460b9-87b1-4052-80f4-d0c2a8cd516c EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Starting to create Csar for component Port Mirroring Configuration 2021-04-14T11:10:54.790Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "01aa96e7-924b-4be4-8f6e-b8ab89efb0ae" INVARIANT_UUID = "aad6bbbf-138d-4c0a-9980-585cabf49999" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate" CURR_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-PortMirroringConfiguration-template.yml,0,674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a93460b9-87b1-4052-80f4-d0c2a8cd516c EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c Ended create Csar for component Port Mirroring Configuration 2021-04-14T11:10:54.791Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "01aa96e7-924b-4be4-8f6e-b8ab89efb0ae" INVARIANT_UUID = "aad6bbbf-138d-4c0a-9980-585cabf49999" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate" CURR_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-PortMirroringConfiguration-template.yml,0,674fed49-d968-458e-9323-8586ef53275f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a93460b9-87b1-4052-80f4-d0c2a8cd516c EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c lock resource with id 674fed49-d968-458e-9323-8586ef53275f 2021-04-14T11:10:56.137Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=984e0787-eb0b-4c74-b2a5-75bebb1ff732 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:56.138Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=984e0787-eb0b-4c74-b2a5-75bebb1ff732 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:10:56.690Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "01aa96e7-924b-4be4-8f6e-b8ab89efb0ae" INVARIANT_UUID = "aad6bbbf-138d-4c0a-9980-585cabf49999" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscacsar" CURR_ARTIFACT_UUID = "674fed49-d968-458e-9323-8586ef53275f.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-PortMirroringConfiguration-csar.csar,0,674fed49-d968-458e-9323-8586ef53275f.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=10674 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c6099dc2-4b43-463b-8e9a-a9a54d47e3b3 EntryTimestamp=2021-04-14T11:10:46.016Z InvocationID=eb1f327b-9c75-4af4-b9b4-c334b6e4fc5c LogTimestamp=2021-04-14T11:10:56.690103Z ResponseDesc=Created Exiting. 2021-04-14T11:10:56.690Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:10:56.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b0a28f-48f8-4ffc-b11f-deac441fad34 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:10:56.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b0a28f-48f8-4ffc-b11f-deac441fad34 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@423ad695 2021-04-14T11:10:56.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b0a28f-48f8-4ffc-b11f-deac441fad34 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:10:56.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77b0a28f-48f8-4ffc-b11f-deac441fad34 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:10:56.790Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d9d83647-0076-46ce-824d-55db299ecfec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:56.790407Z InvocationID=64402040-e4cf-415a-ac34-c77ca4d6db88 LogTimestamp=2021-04-14T11:10:56.790481Z Entering 2021-04-14T11:10:56.790Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d9d83647-0076-46ce-824d-55db299ecfec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:10:56.790407Z InvocationID=64402040-e4cf-415a-ac34-c77ca4d6db88 LogTimestamp=2021-04-14T11:10:56.790481Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:10:57.717Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:57.717Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:57.717Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:57.717Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:10:57.718Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Serviceproxy 2021-04-14T11:10:59.355Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "serviceProxy" RESOURCE_TYPE = "ServiceProxy" SERVICE_INSTANCE_ID = "ecba7707-d01d-4aa4-bc48-d0e3f8448497" INVARIANT_UUID = "1175242f-1ade-480d-b5bc-29ece21720a4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.ServiceProxy" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecba7707-d01d-4aa4-bc48-d0e3f8448497 EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 968de00b-f4dd-42e3-8574-0f306b7ca134 2021-04-14T11:10:59.798Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=77b0a28f-48f8-4ffc-b11f-deac441fad34 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:10:59.799Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=77b0a28f-48f8-4ffc-b11f-deac441fad34 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:00.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c010da8c-6576-43bd-919e-bf098637728d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:00.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c010da8c-6576-43bd-919e-bf098637728d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@494dc9c6 2021-04-14T11:11:00.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c010da8c-6576-43bd-919e-bf098637728d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:00.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c010da8c-6576-43bd-919e-bf098637728d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:00.987Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "serviceProxy" RESOURCE_TYPE = "ServiceProxy" SERVICE_INSTANCE_ID = "ecba7707-d01d-4aa4-bc48-d0e3f8448497" INVARIANT_UUID = "1175242f-1ade-480d-b5bc-29ece21720a4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "968de00b-f4dd-42e3-8574-0f306b7ca134.assettoscatemplate" CURR_ARTIFACT_UUID = "968de00b-f4dd-42e3-8574-0f306b7ca134.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Serviceproxy-template.yml,0,968de00b-f4dd-42e3-8574-0f306b7ca134.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=4196 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=84272a7c-1bac-418b-b62c-f8c3f7dbcf07 EntryTimestamp=2021-04-14T11:10:56.791Z InvocationID=66f44713-d5ff-4f8b-9bdc-232ff2f4a6ec LogTimestamp=2021-04-14T11:11:00.987748Z ResponseDesc=Created Exiting. 2021-04-14T11:11:00.988Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:01.000Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=18452e12-7d87-41ae-8828-d96bc2804238 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:01.000178Z InvocationID=1429316c-6371-4eac-8f72-c3eb353f6188 LogTimestamp=2021-04-14T11:11:01.000412Z Entering 2021-04-14T11:11:01.000Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=18452e12-7d87-41ae-8828-d96bc2804238 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:01.000178Z InvocationID=1429316c-6371-4eac-8f72-c3eb353f6188 LogTimestamp=2021-04-14T11:11:01.000412Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:01.206Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:01.206Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:01.206Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:01.206Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:01.215Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailv2networkrules 2021-04-14T11:11:02.432Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.contrailV2.NetworkRules" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c1d035a0-a9e4-4dba-b2cb-4807c46723cc EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:11:02.433Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.contrailV2.NetworkRules" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c1d035a0-a9e4-4dba-b2cb-4807c46723cc TargetServiceName=null EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:11:02.837Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.contrailV2.NetworkRules" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c1d035a0-a9e4-4dba-b2cb-4807c46723cc TargetServiceName=null EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf ErrorCode=500 lock resource with id b2062149-0dce-4f95-bcb1-b8f6bddcd706 2021-04-14T11:11:03.049Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c010da8c-6576-43bd-919e-bf098637728d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:03.049Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c010da8c-6576-43bd-919e-bf098637728d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:03.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15ee139-4c5b-41c2-b8f2-81c3ba6d9101 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:03.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15ee139-4c5b-41c2-b8f2-81c3ba6d9101 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@557dd191 2021-04-14T11:11:03.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15ee139-4c5b-41c2-b8f2-81c3ba6d9101 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:03.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15ee139-4c5b-41c2-b8f2-81c3ba6d9101 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:11:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:11:04.350Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:11:04.350Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:11:04.832Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate" CURR_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2networkrules-template.yml,0,b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=96ea973c-10fc-4d97-92d5-e74d0655e499 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf ErrorCode=500 Starting to create Csar for component ContrailV2NetworkRules 2021-04-14T11:11:05.064Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate" CURR_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2networkrules-template.yml,0,b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=96ea973c-10fc-4d97-92d5-e74d0655e499 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf ErrorCode=500 Ended create Csar for component ContrailV2NetworkRules 2021-04-14T11:11:05.064Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate" CURR_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2networkrules-template.yml,0,b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=96ea973c-10fc-4d97-92d5-e74d0655e499 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf ErrorCode=500 lock resource with id b2062149-0dce-4f95-bcb1-b8f6bddcd706 2021-04-14T11:11:06.837Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a15ee139-4c5b-41c2-b8f2-81c3ba6d9101 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:06.838Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a15ee139-4c5b-41c2-b8f2-81c3ba6d9101 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:07.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82515b3-28b0-41e2-be5f-7c05f3a2be70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:07.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82515b3-28b0-41e2-be5f-7c05f3a2be70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ae0a54 2021-04-14T11:11:07.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82515b3-28b0-41e2-be5f-7c05f3a2be70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:07.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c82515b3-28b0-41e2-be5f-7c05f3a2be70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:08.535Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2NetworkRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c1d035a0-a9e4-4dba-b2cb-4807c46723cc" INVARIANT_UUID = "ddee73da-2541-420a-9d0a-b6a1e1856ee4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscacsar" CURR_ARTIFACT_UUID = "b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailv2networkrules-csar.csar,0,b2062149-0dce-4f95-bcb1-b8f6bddcd706.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7534 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b01bb46a-eed7-4095-b080-96c01ee3ff5f TargetServiceName=null EntryTimestamp=2021-04-14T11:11:01.001Z InvocationID=a09d807c-b938-4a22-b859-79c6d6d56bdf ErrorCode=500 LogTimestamp=2021-04-14T11:11:08.535631Z ResponseDesc=Created Exiting. 2021-04-14T11:11:08.536Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:08.587Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=40555a6f-fe5a-40e6-bde9-d720f756d449 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:08.587150Z InvocationID=e3136f96-a37a-423b-bc4c-ae4028840b98 LogTimestamp=2021-04-14T11:11:08.587212Z Entering 2021-04-14T11:11:08.587Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=40555a6f-fe5a-40e6-bde9-d720f756d449 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:08.587150Z InvocationID=e3136f96-a37a-423b-bc4c-ae4028840b98 LogTimestamp=2021-04-14T11:11:08.587212Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:10.838Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c82515b3-28b0-41e2-be5f-7c05f3a2be70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:10.838Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c82515b3-28b0-41e2-be5f-7c05f3a2be70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:11.130Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:11.130Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:11.130Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:11.130Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:11.413Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailv2virtualnetwork 2021-04-14T11:11:11.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37dc3e8e-abdd-47c8-b684-0016128046bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:11.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37dc3e8e-abdd-47c8-b684-0016128046bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41311959 2021-04-14T11:11:11.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37dc3e8e-abdd-47c8-b684-0016128046bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:11.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37dc3e8e-abdd-47c8-b684-0016128046bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:13.427Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.contrailV2.VirtualNetwork" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=050989c5-ba5e-4da1-8eac-65745bb42be8 EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:11:13.428Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.contrailV2.VirtualNetwork" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=050989c5-ba5e-4da1-8eac-65745bb42be8 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:11:14.034Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.nodes.heat.network.contrailV2.VirtualNetwork" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=050989c5-ba5e-4da1-8eac-65745bb42be8 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d ErrorCode=500 lock resource with id 5b5da91c-ae94-4213-b8b8-12afbad7f1fb 2021-04-14T11:11:14.733Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=37dc3e8e-abdd-47c8-b684-0016128046bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:14.733Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=37dc3e8e-abdd-47c8-b684-0016128046bf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:15.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1f3336-2abd-4268-8fd9-d318f987b90d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:15.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1f3336-2abd-4268-8fd9-d318f987b90d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41e14992 2021-04-14T11:11:15.301Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1f3336-2abd-4268-8fd9-d318f987b90d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:15.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1f3336-2abd-4268-8fd9-d318f987b90d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:15.994Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate" CURR_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2virtualnetwork-template.yml,0,5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ba65056a-a09b-4f6c-9061-cc949b1adb3b TargetServiceName=null EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d ErrorCode=500 Starting to create Csar for component ContrailV2VirtualNetwork 2021-04-14T11:11:16.198Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate" CURR_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2virtualnetwork-template.yml,0,5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ba65056a-a09b-4f6c-9061-cc949b1adb3b TargetServiceName=null EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d ErrorCode=500 Ended create Csar for component ContrailV2VirtualNetwork 2021-04-14T11:11:16.198Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate" CURR_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2virtualnetwork-template.yml,0,5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ba65056a-a09b-4f6c-9061-cc949b1adb3b TargetServiceName=null EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d ErrorCode=500 lock resource with id 5b5da91c-ae94-4213-b8b8-12afbad7f1fb 2021-04-14T11:11:18.111Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualNetwork" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "050989c5-ba5e-4da1-8eac-65745bb42be8" INVARIANT_UUID = "91258a6f-ec15-4ef8-b741-1c85d1865ebf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscacsar" CURR_ARTIFACT_UUID = "5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailv2virtualnetwork-csar.csar,0,5b5da91c-ae94-4213-b8b8-12afbad7f1fb.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9523 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4612537a-da36-4825-a834-7f9f8829cd98 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:08.587Z InvocationID=8fe9caea-4af4-48c3-acd3-f7934938ff0d ErrorCode=500 LogTimestamp=2021-04-14T11:11:18.110763Z ResponseDesc=Created Exiting. 2021-04-14T11:11:18.112Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:18.187Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9e002aac-5923-4ddf-bba8-48fca6a38284 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:18.186985Z InvocationID=5cd0a9d7-9ea0-4641-a28f-99d322a33b07 LogTimestamp=2021-04-14T11:11:18.187052Z Entering 2021-04-14T11:11:18.187Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9e002aac-5923-4ddf-bba8-48fca6a38284 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:18.186985Z InvocationID=5cd0a9d7-9ea0-4641-a28f-99d322a33b07 LogTimestamp=2021-04-14T11:11:18.187052Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:18.310Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cb1f3336-2abd-4268-8fd9-d318f987b90d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:18.310Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cb1f3336-2abd-4268-8fd9-d318f987b90d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:19.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac66b64-030d-464b-9c4c-b0c6ef9ca0c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:19.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac66b64-030d-464b-9c4c-b0c6ef9ca0c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ff934ff 2021-04-14T11:11:19.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac66b64-030d-464b-9c4c-b0c6ef9ca0c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:19.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac66b64-030d-464b-9c4c-b0c6ef9ca0c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:19.263Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:19.263Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:19.263Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:19.263Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:19.272Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Securityrules 2021-04-14T11:11:20.501Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.neutron.SecurityRules" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:11:20.503Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.neutron.SecurityRules" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a TargetServiceName=null EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:11:20.698Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.rules.nodes.heat.network.neutron.SecurityRules" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a TargetServiceName=null EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 ErrorCode=500 lock resource with id face1f1e-011e-451d-b7ec-f54b4be4132a 2021-04-14T11:11:22.093Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bac66b64-030d-464b-9c4c-b0c6ef9ca0c8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:22.094Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bac66b64-030d-464b-9c4c-b0c6ef9ca0c8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:22.328Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate" CURR_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Securityrules-template.yml,0,face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ae40461f-5d69-418e-8044-1080adf130a2 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 ErrorCode=500 Starting to create Csar for component SecurityRules 2021-04-14T11:11:22.509Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate" CURR_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Securityrules-template.yml,0,face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ae40461f-5d69-418e-8044-1080adf130a2 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 ErrorCode=500 Ended create Csar for component SecurityRules 2021-04-14T11:11:22.509Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate" CURR_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Securityrules-template.yml,0,face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ae40461f-5d69-418e-8044-1080adf130a2 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 ErrorCode=500 lock resource with id face1f1e-011e-451d-b7ec-f54b4be4132a 2021-04-14T11:11:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=224a3f3e-3b62-44b0-8d2a-e33d08e794ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=224a3f3e-3b62-44b0-8d2a-e33d08e794ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f737f49 2021-04-14T11:11:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=224a3f3e-3b62-44b0-8d2a-e33d08e794ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:22.522Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=224a3f3e-3b62-44b0-8d2a-e33d08e794ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:24.262Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "SecurityRules" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "6692f3ae-ce84-4b38-a211-bc5d4bfa6e9a" INVARIANT_UUID = "1d05f396-63a9-4877-a20f-85a742b16cf5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscacsar" CURR_ARTIFACT_UUID = "face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Securityrules-csar.csar,0,face1f1e-011e-451d-b7ec-f54b4be4132a.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6074 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fd8ae08e-0984-4d08-b951-3b40a6de83c8 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:18.187Z InvocationID=6080b9ad-471e-4a94-b9bd-24a2bdf28ee1 ErrorCode=500 LogTimestamp=2021-04-14T11:11:24.261877Z ResponseDesc=Created Exiting. 2021-04-14T11:11:24.263Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:24.334Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2c2d68f3-f455-48ed-81b2-ecca21d2e598 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:24.333729Z InvocationID=c149367a-af02-4bd5-bd79-36a82e7ce032 LogTimestamp=2021-04-14T11:11:24.333772Z Entering 2021-04-14T11:11:24.334Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2c2d68f3-f455-48ed-81b2-ecca21d2e598 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:24.333729Z InvocationID=c149367a-af02-4bd5-bd79-36a82e7ce032 LogTimestamp=2021-04-14T11:11:24.333772Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:25.533Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=224a3f3e-3b62-44b0-8d2a-e33d08e794ec ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:25.533Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=224a3f3e-3b62-44b0-8d2a-e33d08e794ec ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:26.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13a891fd-c1b0-41de-bed3-ee75c240908c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:26.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13a891fd-c1b0-41de-bed3-ee75c240908c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@772bd6fa 2021-04-14T11:11:26.380Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13a891fd-c1b0-41de-bed3-ee75c240908c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:26.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13a891fd-c1b0-41de-bed3-ee75c240908c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:27.312Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:27.313Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:27.313Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:27.313Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:27.313Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailabstractsubstitute 2021-04-14T11:11:29.393Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=13a891fd-c1b0-41de-bed3-ee75c240908c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:29.393Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=13a891fd-c1b0-41de-bed3-ee75c240908c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:30.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a64207a-6df8-4b2a-8954-a3049354e7e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:30.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a64207a-6df8-4b2a-8954-a3049354e7e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ff3df0f 2021-04-14T11:11:30.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a64207a-6df8-4b2a-8954-a3049354e7e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:30.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a64207a-6df8-4b2a-8954-a3049354e7e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:32.138Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailAbstractSubstitute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "98a96be1-ba64-4ed6-bf25-ee18dfca1f2b" INVARIANT_UUID = "42ce3c4d-be91-4c7f-8819-4c443dde9a2a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.contrail.AbstractSubstitute" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=98a96be1-ba64-4ed6-bf25-ee18dfca1f2b EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id b338fa40-27ac-495f-a984-d6e9f36ecb9f 2021-04-14T11:11:33.241Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6a64207a-6df8-4b2a-8954-a3049354e7e3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:33.241Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6a64207a-6df8-4b2a-8954-a3049354e7e3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:34.225Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailAbstractSubstitute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "98a96be1-ba64-4ed6-bf25-ee18dfca1f2b" INVARIANT_UUID = "42ce3c4d-be91-4c7f-8819-4c443dde9a2a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b338fa40-27ac-495f-a984-d6e9f36ecb9f.assettoscatemplate" CURR_ARTIFACT_UUID = "b338fa40-27ac-495f-a984-d6e9f36ecb9f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailabstractsubstitute-template.yml,0,b338fa40-27ac-495f-a984-d6e9f36ecb9f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=9891 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=17a4de76-51cb-4ec6-9123-03a79c557932 EntryTimestamp=2021-04-14T11:11:24.334Z InvocationID=bebf7a31-0d83-4895-9b19-d310158ab10e LogTimestamp=2021-04-14T11:11:34.225119Z ResponseDesc=Created Exiting. 2021-04-14T11:11:34.225Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:34.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d70cdb5-3d56-4b8b-bd9a-30364d625752 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:34.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d70cdb5-3d56-4b8b-bd9a-30364d625752 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d69eee3 2021-04-14T11:11:34.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d70cdb5-3d56-4b8b-bd9a-30364d625752 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:34.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d70cdb5-3d56-4b8b-bd9a-30364d625752 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:34.241Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ea828873-1a45-412c-91d0-622ec5686693 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:34.241415Z InvocationID=c2ed048e-08b9-45db-bec9-d0e06aaa04f7 LogTimestamp=2021-04-14T11:11:34.241486Z Entering 2021-04-14T11:11:34.241Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ea828873-1a45-412c-91d0-622ec5686693 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:34.241415Z InvocationID=c2ed048e-08b9-45db-bec9-d0e06aaa04f7 LogTimestamp=2021-04-14T11:11:34.241486Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:35.391Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:35.391Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:35.391Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:35.392Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:35.392Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailcompute 2021-04-14T11:11:37.240Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5d70cdb5-3d56-4b8b-bd9a-30364d625752 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:37.241Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5d70cdb5-3d56-4b8b-bd9a-30364d625752 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:37.583Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.contrail.Compute" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=eb220d77-7a0c-4727-8d27-7046c578168a EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:11:37.584Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.contrail.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=eb220d77-7a0c-4727-8d27-7046c578168a TargetServiceName=null EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:11:38.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c09973-0334-4d98-aa79-f0557a3f7bdb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:38.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c09973-0334-4d98-aa79-f0557a3f7bdb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74c593f3 2021-04-14T11:11:38.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c09973-0334-4d98-aa79-f0557a3f7bdb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:38.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c09973-0334-4d98-aa79-f0557a3f7bdb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:38.513Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.nodes.heat.contrail.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=eb220d77-7a0c-4727-8d27-7046c578168a TargetServiceName=null EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 ErrorCode=500 lock resource with id 9ec65e16-a81a-4a69-a5fc-24d1a897b651 2021-04-14T11:11:40.045Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:11:40.050Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:11:40.231Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate" CURR_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailcompute-template.yml,0,9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e63df4c4-116c-4116-a616-9786a4b03379 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 ErrorCode=500 Starting to create Csar for component ContrailCompute 2021-04-14T11:11:40.421Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate" CURR_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailcompute-template.yml,0,9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e63df4c4-116c-4116-a616-9786a4b03379 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 ErrorCode=500 Ended create Csar for component ContrailCompute 2021-04-14T11:11:40.421Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate" CURR_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailcompute-template.yml,0,9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e63df4c4-116c-4116-a616-9786a4b03379 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 ErrorCode=500 lock resource with id 9ec65e16-a81a-4a69-a5fc-24d1a897b651 2021-04-14T11:11:41.096Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=25c09973-0334-4d98-aa79-f0557a3f7bdb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:41.096Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=25c09973-0334-4d98-aa79-f0557a3f7bdb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:41.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fd0930-9bb7-4510-b416-df2b140adb0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:41.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fd0930-9bb7-4510-b416-df2b140adb0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71264bc5 2021-04-14T11:11:41.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fd0930-9bb7-4510-b416-df2b140adb0c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:41.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fd0930-9bb7-4510-b416-df2b140adb0c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:42.027Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailCompute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "eb220d77-7a0c-4727-8d27-7046c578168a" INVARIANT_UUID = "d2bc19b2-f2bd-4fec-8162-ec69a09468d6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscacsar" CURR_ARTIFACT_UUID = "9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailcompute-csar.csar,0,9ec65e16-a81a-4a69-a5fc-24d1a897b651.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7785 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=880e4544-01c6-469c-b319-0886f3e464ca TargetServiceName=null EntryTimestamp=2021-04-14T11:11:34.242Z InvocationID=918f541d-f17a-4ff4-98ac-eb85a0a380c7 ErrorCode=500 LogTimestamp=2021-04-14T11:11:42.027491Z ResponseDesc=Created Exiting. 2021-04-14T11:11:42.028Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:42.045Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bc2702cc-850d-4014-a582-8817e610c020 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:42.044836Z InvocationID=707f879b-d21b-4c1e-99fc-6e53d14caeeb LogTimestamp=2021-04-14T11:11:42.044904Z Entering 2021-04-14T11:11:42.045Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bc2702cc-850d-4014-a582-8817e610c020 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:42.044836Z InvocationID=707f879b-d21b-4c1e-99fc-6e53d14caeeb LogTimestamp=2021-04-14T11:11:42.044904Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:42.466Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:42.467Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:42.467Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:42.467Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:42.525Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailv2virtualmachineinterface 2021-04-14T11:11:42.783Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:11:42.783Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:11:44.338Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.contrailV2.VirtualMachineInterface" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7663c2a6-388d-4bff-bace-6879b8a2d635 EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:11:44.338Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.contrailV2.VirtualMachineInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7663c2a6-388d-4bff-bace-6879b8a2d635 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:11:44.341Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=08fd0930-9bb7-4510-b416-df2b140adb0c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:44.341Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=08fd0930-9bb7-4510-b416-df2b140adb0c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:45.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb28755-9359-440c-8918-612437d6a650 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:45.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb28755-9359-440c-8918-612437d6a650 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35f87af5 2021-04-14T11:11:45.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb28755-9359-440c-8918-612437d6a650 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:45.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eb28755-9359-440c-8918-612437d6a650 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:47.130Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.contrailV2.VirtualMachineInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7663c2a6-388d-4bff-bace-6879b8a2d635 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 ErrorCode=500 lock resource with id 5856a558-d6d6-4e0f-8482-414761563a8d 2021-04-14T11:11:48.235Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7eb28755-9359-440c-8918-612437d6a650 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:48.236Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7eb28755-9359-440c-8918-612437d6a650 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:49.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc83389-e6b3-4724-a390-7aba51845167 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:49.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc83389-e6b3-4724-a390-7aba51845167 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30525743 2021-04-14T11:11:49.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc83389-e6b3-4724-a390-7aba51845167 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:49.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc83389-e6b3-4724-a390-7aba51845167 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:50.228Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate" CURR_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2virtualmachineinterface-template.yml,0,5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c00dca45-48ea-44a4-a944-2673ed708fb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 ErrorCode=500 Starting to create Csar for component ContrailV2VirtualMachineInterface 2021-04-14T11:11:50.566Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate" CURR_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2virtualmachineinterface-template.yml,0,5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c00dca45-48ea-44a4-a944-2673ed708fb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 ErrorCode=500 Ended create Csar for component ContrailV2VirtualMachineInterface 2021-04-14T11:11:50.566Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate" CURR_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2virtualmachineinterface-template.yml,0,5856a558-d6d6-4e0f-8482-414761563a8d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c00dca45-48ea-44a4-a944-2673ed708fb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 ErrorCode=500 lock resource with id 5856a558-d6d6-4e0f-8482-414761563a8d 2021-04-14T11:11:52.141Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2cc83389-e6b3-4724-a390-7aba51845167 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:52.141Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2cc83389-e6b3-4724-a390-7aba51845167 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:52.642Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ContrailV2VirtualMachineInterface" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7663c2a6-388d-4bff-bace-6879b8a2d635" INVARIANT_UUID = "ca1de2fc-b50f-4e87-b041-30e785a6be71" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscacsar" CURR_ARTIFACT_UUID = "5856a558-d6d6-4e0f-8482-414761563a8d.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailv2virtualmachineinterface-csar.csar,0,5856a558-d6d6-4e0f-8482-414761563a8d.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=10596 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=df332227-6ade-4d3e-89bb-f853b80e4cae TargetServiceName=null EntryTimestamp=2021-04-14T11:11:42.045Z InvocationID=346b9518-f134-420f-b6d0-8f7f1d9b4aa9 ErrorCode=500 LogTimestamp=2021-04-14T11:11:52.641321Z ResponseDesc=Created Exiting. 2021-04-14T11:11:52.642Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:11:52.718Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4a386ce3-1939-43c1-a9c7-e6197b225676 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:52.717736Z InvocationID=ff19ae1d-bbfa-476e-8d7a-2e656e0428c7 LogTimestamp=2021-04-14T11:11:52.717798Z Entering 2021-04-14T11:11:52.718Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4a386ce3-1939-43c1-a9c7-e6197b225676 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:11:52.717736Z InvocationID=ff19ae1d-bbfa-476e-8d7a-2e656e0428c7 LogTimestamp=2021-04-14T11:11:52.717798Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:11:53.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=645e3d9a-ba25-4060-8871-2017b403e402 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:53.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=645e3d9a-ba25-4060-8871-2017b403e402 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a78447e 2021-04-14T11:11:53.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=645e3d9a-ba25-4060-8871-2017b403e402 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:53.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=645e3d9a-ba25-4060-8871-2017b403e402 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:53.539Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:53.539Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:53.539Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:53.539Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:11:53.540Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Subinterface 2021-04-14T11:11:55.204Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.SubInterface" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9db94d7a-1a26-4d0b-bec1-b52df49c6b4f EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:11:55.204Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.SubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9db94d7a-1a26-4d0b-bec1-b52df49c6b4f TargetServiceName=null EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:11:56.094Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.SubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9db94d7a-1a26-4d0b-bec1-b52df49c6b4f TargetServiceName=null EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 ErrorCode=500 lock resource with id 4a8b7407-444b-40fb-a623-933d06e7af84 2021-04-14T11:11:56.135Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=645e3d9a-ba25-4060-8871-2017b403e402 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:56.135Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=645e3d9a-ba25-4060-8871-2017b403e402 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:11:56.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7deb4-1f51-48c7-b906-0a9ecfa759c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:11:56.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7deb4-1f51-48c7-b906-0a9ecfa759c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61f61bc0 2021-04-14T11:11:56.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7deb4-1f51-48c7-b906-0a9ecfa759c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:11:56.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7deb4-1f51-48c7-b906-0a9ecfa759c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:11:57.907Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate" CURR_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Subinterface-template.yml,0,4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=803d969e-364a-4a49-a6ea-c8f457f796f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 ErrorCode=500 Starting to create Csar for component subInterface 2021-04-14T11:11:58.201Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate" CURR_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Subinterface-template.yml,0,4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=803d969e-364a-4a49-a6ea-c8f457f796f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 ErrorCode=500 Ended create Csar for component subInterface 2021-04-14T11:11:58.201Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate" CURR_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Subinterface-template.yml,0,4a8b7407-444b-40fb-a623-933d06e7af84.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=803d969e-364a-4a49-a6ea-c8f457f796f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 ErrorCode=500 lock resource with id 4a8b7407-444b-40fb-a623-933d06e7af84 2021-04-14T11:11:59.801Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3ee7deb4-1f51-48c7-b906-0a9ecfa759c4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:11:59.801Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3ee7deb4-1f51-48c7-b906-0a9ecfa759c4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:00.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bd3bc6-eab7-4b78-819f-55a5e016183e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:00.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bd3bc6-eab7-4b78-819f-55a5e016183e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5873c32b 2021-04-14T11:12:00.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bd3bc6-eab7-4b78-819f-55a5e016183e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:00.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bd3bc6-eab7-4b78-819f-55a5e016183e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:00.026Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "9db94d7a-1a26-4d0b-bec1-b52df49c6b4f" INVARIANT_UUID = "deeaea99-9ef8-4c75-80bf-5267630ffdad" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscacsar" CURR_ARTIFACT_UUID = "4a8b7407-444b-40fb-a623-933d06e7af84.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Subinterface-csar.csar,0,4a8b7407-444b-40fb-a623-933d06e7af84.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7307 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=54bab660-3103-4408-9908-e636fa0000ef TargetServiceName=null EntryTimestamp=2021-04-14T11:11:52.718Z InvocationID=20bd05bc-e7c5-4b35-bb8a-bac3e5719d46 ErrorCode=500 LogTimestamp=2021-04-14T11:12:00.025976Z ResponseDesc=Created Exiting. 2021-04-14T11:12:00.026Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:00.050Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=273ac1e5-a3ab-44f2-8d4d-68cfe8a94ca2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:00.050210Z InvocationID=d56409e1-589d-4be6-b5cd-c182d1a65e7b LogTimestamp=2021-04-14T11:12:00.050247Z Entering 2021-04-14T11:12:00.050Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=273ac1e5-a3ab-44f2-8d4d-68cfe8a94ca2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:00.050210Z InvocationID=d56409e1-589d-4be6-b5cd-c182d1a65e7b LogTimestamp=2021-04-14T11:12:00.050247Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:00.316Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:00.316Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:00.316Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:00.316Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:00.325Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailv2vlansubinterface 2021-04-14T11:12:01.515Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.contrailV2.VLANSubInterface" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5 EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:12:01.515Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.contrailV2.VLANSubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:12:01.738Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.contrailV2.VLANSubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 ErrorCode=500 lock resource with id 05e9b446-54a5-48dc-86a5-5bdf910ce3d2 2021-04-14T11:12:03.024Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a0bd3bc6-eab7-4b78-819f-55a5e016183e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:12:03.024Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a0bd3bc6-eab7-4b78-819f-55a5e016183e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:03.823Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate" CURR_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2vlansubinterface-template.yml,0,05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2fb4398f-7f2c-4b18-b084-55a0e775368a TargetServiceName=null EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 ErrorCode=500 Starting to create Csar for component contrailV2VLANSubInterface 2021-04-14T11:12:03.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec01cd61-6d73-44c6-bdd5-73c86c929626 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:03.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec01cd61-6d73-44c6-bdd5-73c86c929626 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f351160 2021-04-14T11:12:03.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec01cd61-6d73-44c6-bdd5-73c86c929626 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:03.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec01cd61-6d73-44c6-bdd5-73c86c929626 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:04.025Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate" CURR_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2vlansubinterface-template.yml,0,05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2fb4398f-7f2c-4b18-b084-55a0e775368a TargetServiceName=null EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 ErrorCode=500 Ended create Csar for component contrailV2VLANSubInterface 2021-04-14T11:12:04.026Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate" CURR_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2vlansubinterface-template.yml,0,05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2fb4398f-7f2c-4b18-b084-55a0e775368a TargetServiceName=null EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 ErrorCode=500 lock resource with id 05e9b446-54a5-48dc-86a5-5bdf910ce3d2 2021-04-14T11:12:06.841Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ec01cd61-6d73-44c6-bdd5-73c86c929626 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:12:06.841Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ec01cd61-6d73-44c6-bdd5-73c86c929626 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:06.939Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterface" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ecdd1e38-1296-4bfd-8a6b-0d20b5d4b2c5" INVARIANT_UUID = "05c1df5e-39dc-4957-b303-c0475856692e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscacsar" CURR_ARTIFACT_UUID = "05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailv2vlansubinterface-csar.csar,0,05e9b446-54a5-48dc-86a5-5bdf910ce3d2.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6889 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=39d1dcf2-93c5-48e3-93f4-38fe1b6f2cf4 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:00.050Z InvocationID=bf4aef2e-8352-42c9-9530-1024750b3231 ErrorCode=500 LogTimestamp=2021-04-14T11:12:06.939010Z ResponseDesc=Created Exiting. 2021-04-14T11:12:06.939Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:07.189Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=19605aed-c5a9-4fd9-a864-8b18e9297706 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:07.188476Z InvocationID=d8b99b17-59b7-4bf4-93d2-d72f1fba9dd4 LogTimestamp=2021-04-14T11:12:07.188565Z Entering 2021-04-14T11:12:07.189Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=19605aed-c5a9-4fd9-a864-8b18e9297706 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:07.188476Z InvocationID=d8b99b17-59b7-4bf4-93d2-d72f1fba9dd4 LogTimestamp=2021-04-14T11:12:07.188565Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:07.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa7cb447-4a16-4041-affd-568c4b24ac88 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:07.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa7cb447-4a16-4041-affd-568c4b24ac88 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@86fd3b5 2021-04-14T11:12:07.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa7cb447-4a16-4041-affd-568c4b24ac88 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:07.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa7cb447-4a16-4041-affd-568c4b24ac88 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:10.329Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:10.330Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:10.330Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:10.330Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:10.330Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Multiflavorvfc 2021-04-14T11:12:10.818Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=aa7cb447-4a16-4041-affd-568c4b24ac88 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:12:10.818Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=aa7cb447-4a16-4041-affd-568c4b24ac88 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:11.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321fe5a5-74ab-42eb-8990-0aa27a1a5202 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:11.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321fe5a5-74ab-42eb-8990-0aa27a1a5202 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10ee65fc 2021-04-14T11:12:11.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321fe5a5-74ab-42eb-8990-0aa27a1a5202 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:11.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=321fe5a5-74ab-42eb-8990-0aa27a1a5202 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:13.430Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "multiFlavorVFC" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "fd767058-9c07-4216-a4d7-38dc85e25194" INVARIANT_UUID = "fc3fe62d-b18b-4b4b-ba61-988af03a6c2e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.MultiFlavorVFC" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fd767058-9c07-4216-a4d7-38dc85e25194 EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 772c084d-ff5f-422c-8405-4b6c914f855a 2021-04-14T11:12:14.628Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=321fe5a5-74ab-42eb-8990-0aa27a1a5202 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:12:14.629Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=321fe5a5-74ab-42eb-8990-0aa27a1a5202 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:15.262Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:12:15.263Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:12:15.263Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:12:15.264Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:12:15.264Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:12:15.264Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:12:15.264Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:12:15.513Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "multiFlavorVFC" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "fd767058-9c07-4216-a4d7-38dc85e25194" INVARIANT_UUID = "fc3fe62d-b18b-4b4b-ba61-988af03a6c2e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "772c084d-ff5f-422c-8405-4b6c914f855a.assettoscatemplate" CURR_ARTIFACT_UUID = "772c084d-ff5f-422c-8405-4b6c914f855a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Multiflavorvfc-template.yml,0,772c084d-ff5f-422c-8405-4b6c914f855a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=8324 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1f0f5f05-5bca-442f-a815-51deb41c0f02 EntryTimestamp=2021-04-14T11:12:07.189Z InvocationID=2ee56b0e-ad94-4f53-9ed4-67147bdbb9ef LogTimestamp=2021-04-14T11:12:15.513321Z ResponseDesc=Created Exiting. 2021-04-14T11:12:15.514Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:15.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900341-4246-4739-b10e-ce0b05e16bf6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:15.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900341-4246-4739-b10e-ce0b05e16bf6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3120b855 2021-04-14T11:12:15.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900341-4246-4739-b10e-ce0b05e16bf6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:15.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900341-4246-4739-b10e-ce0b05e16bf6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:15.589Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=50393d55-a72d-4cca-b840-3cf41718d55c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:15.589251Z InvocationID=0270ea78-1c0e-4b86-b5dd-ce794ce3ed2f LogTimestamp=2021-04-14T11:12:15.589331Z Entering 2021-04-14T11:12:15.590Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=50393d55-a72d-4cca-b840-3cf41718d55c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:15.589251Z InvocationID=0270ea78-1c0e-4b86-b5dd-ce794ce3ed2f LogTimestamp=2021-04-14T11:12:15.589331Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:16.509Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:16.509Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:16.509Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:16.509Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:16.509Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Vnfconfiguration 2021-04-14T11:12:18.596Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=23900341-4246-4739-b10e-ce0b05e16bf6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:12:18.597Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=23900341-4246-4739-b10e-ce0b05e16bf6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:19.283Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "vnfConfiguration" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "887725b5-443e-48fc-8e72-5b78da888d73" INVARIANT_UUID = "c6a9cac9-dcf3-4c04-bb50-7aea4a1478c6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.abstract.nodes.VnfConfiguration" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=887725b5-443e-48fc-8e72-5b78da888d73 EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 9a7258f9-9b8c-4c3e-8901-987b179e8214 2021-04-14T11:12:19.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7095d0-68c3-408a-9f2c-83bccc4d4750 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:19.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7095d0-68c3-408a-9f2c-83bccc4d4750 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bbf8d9c 2021-04-14T11:12:19.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7095d0-68c3-408a-9f2c-83bccc4d4750 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:19.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7095d0-68c3-408a-9f2c-83bccc4d4750 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:20.965Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "vnfConfiguration" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "887725b5-443e-48fc-8e72-5b78da888d73" INVARIANT_UUID = "c6a9cac9-dcf3-4c04-bb50-7aea4a1478c6" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "9a7258f9-9b8c-4c3e-8901-987b179e8214.assettoscatemplate" CURR_ARTIFACT_UUID = "9a7258f9-9b8c-4c3e-8901-987b179e8214.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnfconfiguration-template.yml,0,9a7258f9-9b8c-4c3e-8901-987b179e8214.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=5375 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d3a46700-ff9b-46c4-9bcb-88bbce353a0a EntryTimestamp=2021-04-14T11:12:15.590Z InvocationID=cbe774ac-ca2a-4c8a-854e-a1beaa6ba153 LogTimestamp=2021-04-14T11:12:20.965699Z ResponseDesc=Created Exiting. 2021-04-14T11:12:20.966Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:20.985Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e298b5b9-afb7-435e-ac21-8262b1122a67 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:20.985292Z InvocationID=d624349e-312f-4b39-93d4-c2bb25b58398 LogTimestamp=2021-04-14T11:12:20.985356Z Entering 2021-04-14T11:12:20.986Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e298b5b9-afb7-435e-ac21-8262b1122a67 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:20.985292Z InvocationID=d624349e-312f-4b39-93d4-c2bb25b58398 LogTimestamp=2021-04-14T11:12:20.985356Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:21.197Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:21.197Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:21.197Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:21.197Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:21.209Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Extcp2 2021-04-14T11:12:22.108Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:12:22.109Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:12:22.109Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:12:22.399Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2f7095d0-68c3-408a-9f2c-83bccc4d4750 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:12:22.399Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2f7095d0-68c3-408a-9f2c-83bccc4d4750 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:12:22.536Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extCP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:12:22.537Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f TargetServiceName=null EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:12:22.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808f76a-f98d-4df2-b965-4537d31505bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:22.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808f76a-f98d-4df2-b965-4537d31505bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29e0dd26 2021-04-14T11:12:22.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808f76a-f98d-4df2-b965-4537d31505bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:22.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b808f76a-f98d-4df2-b965-4537d31505bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:23.225Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f TargetServiceName=null EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 ErrorCode=500 lock resource with id 22414feb-f9cd-4451-a821-da37b3f3ffed 2021-04-14T11:12:24.951Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate" CURR_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcp2-template.yml,0,22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3455fdb5-c9bb-4f1a-8d7b-99bb1a10d09e TargetServiceName=null EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 ErrorCode=500 Starting to create Csar for component ExtCP2 2021-04-14T11:12:25.205Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate" CURR_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcp2-template.yml,0,22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3455fdb5-c9bb-4f1a-8d7b-99bb1a10d09e TargetServiceName=null EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 ErrorCode=500 Ended create Csar for component ExtCP2 2021-04-14T11:12:25.205Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate" CURR_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcp2-template.yml,0,22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3455fdb5-c9bb-4f1a-8d7b-99bb1a10d09e TargetServiceName=null EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 ErrorCode=500 lock resource with id 22414feb-f9cd-4451-a821-da37b3f3ffed 2021-04-14T11:12:28.391Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ExtCP2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "4b3dff59-a8ca-4d8d-82b2-93e7da1c4e2f" INVARIANT_UUID = "32e8cc64-7fb0-4717-a56d-88f6a87dd8cf" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscacsar" CURR_ARTIFACT_UUID = "22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Extcp2-csar.csar,0,22414feb-f9cd-4451-a821-da37b3f3ffed.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=7404 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b604370c-c3ad-4c7a-ac94-97c2cbb7bd5e TargetServiceName=null EntryTimestamp=2021-04-14T11:12:20.986Z InvocationID=b9ad28e2-00a0-4814-a45d-ac35dea92b23 ErrorCode=500 LogTimestamp=2021-04-14T11:12:28.390916Z ResponseDesc=Created Exiting. 2021-04-14T11:12:28.391Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:28.432Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ab075494-06df-45e6-9d8e-13014022d331 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:28.432477Z InvocationID=bcd9bc18-345a-455d-bd17-633c84e26aa8 LogTimestamp=2021-04-14T11:12:28.432530Z Entering 2021-04-14T11:12:28.432Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ab075494-06df-45e6-9d8e-13014022d331 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:28.432477Z InvocationID=bcd9bc18-345a-455d-bd17-633c84e26aa8 LogTimestamp=2021-04-14T11:12:28.432530Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:28.939Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b808f76a-f98d-4df2-b965-4537d31505bb ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:12:28.940Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b808f76a-f98d-4df2-b965-4537d31505bb ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:12:29.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab1a4f1a-efa5-4bb6-a8b9-6d51cca53229 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:29.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab1a4f1a-efa5-4bb6-a8b9-6d51cca53229 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58884d8c 2021-04-14T11:12:29.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab1a4f1a-efa5-4bb6-a8b9-6d51cca53229 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:29.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab1a4f1a-efa5-4bb6-a8b9-6d51cca53229 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:31.023Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:31.023Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:31.023Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:31.023Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:31.213Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Extneutroncp 2021-04-14T11:12:31.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d41a59-42fd-4b64-ad90-c1b0b792d6c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:31.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d41a59-42fd-4b64-ad90-c1b0b792d6c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74f492dc 2021-04-14T11:12:31.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d41a59-42fd-4b64-ad90-c1b0b792d6c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:31.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d41a59-42fd-4b64-ad90-c1b0b792d6c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:32.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa61090b-94f7-462e-bcc5-a8bd1c7ed98d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:32.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa61090b-94f7-462e-bcc5-a8bd1c7ed98d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bd26889 2021-04-14T11:12:32.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa61090b-94f7-462e-bcc5-a8bd1c7ed98d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:32.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa61090b-94f7-462e-bcc5-a8bd1c7ed98d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:33.213Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extNeutronCP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6b9e5873-572a-47eb-8a1f-d6d51a15cd14 EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:12:33.215Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extNeutronCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6b9e5873-572a-47eb-8a1f-d6d51a15cd14 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:12:33.931Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extNeutronCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6b9e5873-572a-47eb-8a1f-d6d51a15cd14 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d ErrorCode=500 lock resource with id f50a22b0-39ce-4320-886f-4b30f43111f6 2021-04-14T11:12:34.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c810ca1-42ca-4de1-806e-603835c5c496 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:34.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c810ca1-42ca-4de1-806e-603835c5c496 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6372a3bd 2021-04-14T11:12:34.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c810ca1-42ca-4de1-806e-603835c5c496 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:34.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c810ca1-42ca-4de1-806e-603835c5c496 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:35.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af104309-1e3b-4039-a76f-4246af8edb5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:35.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af104309-1e3b-4039-a76f-4246af8edb5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@790c6672 2021-04-14T11:12:35.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af104309-1e3b-4039-a76f-4246af8edb5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:35.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af104309-1e3b-4039-a76f-4246af8edb5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:35.916Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate" CURR_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extneutroncp-template.yml,0,f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e7377f12-455f-4b3c-a336-ec02dcab3ceb TargetServiceName=null EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d ErrorCode=500 Starting to create Csar for component extNeutronCP 2021-04-14T11:12:36.089Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate" CURR_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extneutroncp-template.yml,0,f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e7377f12-455f-4b3c-a336-ec02dcab3ceb TargetServiceName=null EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d ErrorCode=500 Ended create Csar for component extNeutronCP 2021-04-14T11:12:36.089Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate" CURR_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extneutroncp-template.yml,0,f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e7377f12-455f-4b3c-a336-ec02dcab3ceb TargetServiceName=null EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d ErrorCode=500 lock resource with id f50a22b0-39ce-4320-886f-4b30f43111f6 2021-04-14T11:12:36.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f61091b8-0c19-4488-b9da-a4a548d1d97b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:36.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f61091b8-0c19-4488-b9da-a4a548d1d97b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@293e69fd 2021-04-14T11:12:36.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f61091b8-0c19-4488-b9da-a4a548d1d97b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:36.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f61091b8-0c19-4488-b9da-a4a548d1d97b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:37.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360f2581-8f32-46db-b398-9457dc823ef3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:37.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360f2581-8f32-46db-b398-9457dc823ef3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61e0ca73 2021-04-14T11:12:37.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360f2581-8f32-46db-b398-9457dc823ef3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:37.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360f2581-8f32-46db-b398-9457dc823ef3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:38.012Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extNeutronCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "6b9e5873-572a-47eb-8a1f-d6d51a15cd14" INVARIANT_UUID = "e1ed8ace-9a6c-4ab7-a1ed-9753d916260a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscacsar" CURR_ARTIFACT_UUID = "f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Extneutroncp-csar.csar,0,f50a22b0-39ce-4320-886f-4b30f43111f6.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9579 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5c33e325-4c02-4ec0-827b-139dceed78cb TargetServiceName=null EntryTimestamp=2021-04-14T11:12:28.433Z InvocationID=30f7b308-5882-4665-8b53-a3d92cbe673d ErrorCode=500 LogTimestamp=2021-04-14T11:12:38.012328Z ResponseDesc=Created Exiting. 2021-04-14T11:12:38.012Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:38.027Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c3e787a4-933a-4f88-a6e9-71bc98da1c3c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:38.027200Z InvocationID=48aeb668-2481-4126-86e5-777411b193f7 LogTimestamp=2021-04-14T11:12:38.027254Z Entering 2021-04-14T11:12:38.027Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c3e787a4-933a-4f88-a6e9-71bc98da1c3c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:38.027200Z InvocationID=48aeb668-2481-4126-86e5-777411b193f7 LogTimestamp=2021-04-14T11:12:38.027254Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:38.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c81fe22f-0d2a-4112-8d8e-c738ccc0970c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:38.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c81fe22f-0d2a-4112-8d8e-c738ccc0970c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1779f2b9 2021-04-14T11:12:38.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c81fe22f-0d2a-4112-8d8e-c738ccc0970c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:38.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c81fe22f-0d2a-4112-8d8e-c738ccc0970c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:38.985Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:38.985Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:38.985Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:38.985Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:38.986Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Extcontrailcp 2021-04-14T11:12:40.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e26ec90c-8f5a-4b41-80ba-b2db83895b31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:40.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e26ec90c-8f5a-4b41-80ba-b2db83895b31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ddc39d2 2021-04-14T11:12:40.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e26ec90c-8f5a-4b41-80ba-b2db83895b31 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:40.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e26ec90c-8f5a-4b41-80ba-b2db83895b31 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:40.223Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extContrailCP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5e94023f-ad7b-41d5-ba33-dd9bd12ce73a EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:12:40.224Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extContrailCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5e94023f-ad7b-41d5-ba33-dd9bd12ce73a TargetServiceName=null EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:12:40.384Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extContrailCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5e94023f-ad7b-41d5-ba33-dd9bd12ce73a TargetServiceName=null EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 ErrorCode=500 lock resource with id e00de4fc-cbcb-46e5-9d3c-9708c21e9a49 2021-04-14T11:12:41.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7452b25b-d8b8-4dd8-995f-bd56b83f9b20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7452b25b-d8b8-4dd8-995f-bd56b83f9b20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57f7d815 2021-04-14T11:12:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7452b25b-d8b8-4dd8-995f-bd56b83f9b20 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7452b25b-d8b8-4dd8-995f-bd56b83f9b20 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:41.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020448f2-8798-460e-916d-78e3b8eba7c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:41.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020448f2-8798-460e-916d-78e3b8eba7c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30a323ca 2021-04-14T11:12:41.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020448f2-8798-460e-916d-78e3b8eba7c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:41.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020448f2-8798-460e-916d-78e3b8eba7c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:42.023Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate" CURR_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcontrailcp-template.yml,0,e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8802fadf-5db9-4c8f-afed-1629cdf9bea1 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 ErrorCode=500 Starting to create Csar for component extContrailCP 2021-04-14T11:12:42.191Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate" CURR_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcontrailcp-template.yml,0,e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8802fadf-5db9-4c8f-afed-1629cdf9bea1 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 ErrorCode=500 Ended create Csar for component extContrailCP 2021-04-14T11:12:42.192Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate" CURR_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extcontrailcp-template.yml,0,e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8802fadf-5db9-4c8f-afed-1629cdf9bea1 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 ErrorCode=500 lock resource with id e00de4fc-cbcb-46e5-9d3c-9708c21e9a49 2021-04-14T11:12:42.445Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3849cc8-40e6-47eb-832e-28d7a5daaca1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:42.445Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3849cc8-40e6-47eb-832e-28d7a5daaca1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6897f35d 2021-04-14T11:12:42.445Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3849cc8-40e6-47eb-832e-28d7a5daaca1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:42.445Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3849cc8-40e6-47eb-832e-28d7a5daaca1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:43.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f1f64fe-bda3-4059-84b6-8497a9d2aa4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:43.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f1f64fe-bda3-4059-84b6-8497a9d2aa4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e95534 2021-04-14T11:12:43.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f1f64fe-bda3-4059-84b6-8497a9d2aa4b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:43.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f1f64fe-bda3-4059-84b6-8497a9d2aa4b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:43.938Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extContrailCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "5e94023f-ad7b-41d5-ba33-dd9bd12ce73a" INVARIANT_UUID = "7ac64750-1e9c-4acb-88f2-26cf38b0310d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscacsar" CURR_ARTIFACT_UUID = "e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Extcontrailcp-csar.csar,0,e00de4fc-cbcb-46e5-9d3c-9708c21e9a49.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=5910 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ad714be0-ff59-4110-ab27-81150c4dd444 TargetServiceName=null EntryTimestamp=2021-04-14T11:12:38.028Z InvocationID=351012dc-c4b5-433b-9030-9099db371833 ErrorCode=500 LogTimestamp=2021-04-14T11:12:43.938273Z ResponseDesc=Created Exiting. 2021-04-14T11:12:43.939Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:43.952Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d00c05cd-a007-4365-9b63-d54364d8b71e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:43.952507Z InvocationID=7362ab3f-64c8-4f58-9c0f-976c3e618b1c LogTimestamp=2021-04-14T11:12:43.952556Z Entering 2021-04-14T11:12:43.952Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d00c05cd-a007-4365-9b63-d54364d8b71e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:43.952507Z InvocationID=7362ab3f-64c8-4f58-9c0f-976c3e618b1c LogTimestamp=2021-04-14T11:12:43.952556Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:44.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb9b462-b6bd-47b5-a2a6-9d3f1d83e887 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:44.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb9b462-b6bd-47b5-a2a6-9d3f1d83e887 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6db702cc 2021-04-14T11:12:44.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb9b462-b6bd-47b5-a2a6-9d3f1d83e887 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:44.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb9b462-b6bd-47b5-a2a6-9d3f1d83e887 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:45.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d7b224b-1a3d-46c2-aaa8-cb43c6f55c77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:45.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d7b224b-1a3d-46c2-aaa8-cb43c6f55c77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4423d1c3 2021-04-14T11:12:45.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d7b224b-1a3d-46c2-aaa8-cb43c6f55c77 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:45.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d7b224b-1a3d-46c2-aaa8-cb43c6f55c77 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:47.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a918674f-82e7-4f88-afba-44805a6742c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:47.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a918674f-82e7-4f88-afba-44805a6742c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1379df01 2021-04-14T11:12:47.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a918674f-82e7-4f88-afba-44805a6742c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:47.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a918674f-82e7-4f88-afba-44805a6742c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:47.915Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:47.915Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:47.915Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:47.916Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:48.142Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name PortMirroringConfigurationByPolicy 2021-04-14T11:12:49.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78aca7ad-588a-4a3f-85d4-dea57a2a97dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:49.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78aca7ad-588a-4a3f-85d4-dea57a2a97dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5df778af 2021-04-14T11:12:49.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78aca7ad-588a-4a3f-85d4-dea57a2a97dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:49.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78aca7ad-588a-4a3f-85d4-dea57a2a97dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:50.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4111c463-cc1c-4141-bf9f-4469dbba02e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:50.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4111c463-cc1c-4141-bf9f-4469dbba02e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@803b0bf 2021-04-14T11:12:50.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4111c463-cc1c-4141-bf9f-4469dbba02e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:50.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4111c463-cc1c-4141-bf9f-4469dbba02e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:52.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82b4257b-9b65-43d4-962c-d72b489b4ef1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:52.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82b4257b-9b65-43d4-962c-d72b489b4ef1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5274d5b5 2021-04-14T11:12:52.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82b4257b-9b65-43d4-962c-d72b489b4ef1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:52.325Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82b4257b-9b65-43d4-962c-d72b489b4ef1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:53.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816057c7-2224-4ada-80e9-7f5d4780fac2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:53.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816057c7-2224-4ada-80e9-7f5d4780fac2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fa8992d 2021-04-14T11:12:53.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816057c7-2224-4ada-80e9-7f5d4780fac2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:53.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=816057c7-2224-4ada-80e9-7f5d4780fac2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:53.545Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Port Mirroring Configuration By Policy" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "7c755096-e9b6-4f28-8c1e-b4aab26ae9e4" INVARIANT_UUID = "e2a07c2e-b586-41c1-86ab-24c46b5f7f95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.PortMirroringConfigurationByPolicy" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7c755096-e9b6-4f28-8c1e-b4aab26ae9e4 EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id b4199ab4-d0f8-44ac-a108-8041822de48d 2021-04-14T11:12:54.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bf9148-92a0-4cc5-a13e-40ef020dfff7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:54.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bf9148-92a0-4cc5-a13e-40ef020dfff7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@697cba77 2021-04-14T11:12:54.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bf9148-92a0-4cc5-a13e-40ef020dfff7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:54.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bf9148-92a0-4cc5-a13e-40ef020dfff7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:55.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b279549e-0475-4b94-9220-06b8fcf19e3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:55.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b279549e-0475-4b94-9220-06b8fcf19e3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cef79af 2021-04-14T11:12:55.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b279549e-0475-4b94-9220-06b8fcf19e3e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:55.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b279549e-0475-4b94-9220-06b8fcf19e3e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:55.918Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration By Policy" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "7c755096-e9b6-4f28-8c1e-b4aab26ae9e4" INVARIANT_UUID = "e2a07c2e-b586-41c1-86ab-24c46b5f7f95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate" CURR_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-PortMirroringConfigurationByPolicy-template.yml,0,b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b6895c40-1190-4e51-8a91-f59c25f0f6b8 EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Starting to create Csar for component Port Mirroring Configuration By Policy 2021-04-14T11:12:56.165Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration By Policy" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "7c755096-e9b6-4f28-8c1e-b4aab26ae9e4" INVARIANT_UUID = "e2a07c2e-b586-41c1-86ab-24c46b5f7f95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate" CURR_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-PortMirroringConfigurationByPolicy-template.yml,0,b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b6895c40-1190-4e51-8a91-f59c25f0f6b8 EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 Ended create Csar for component Port Mirroring Configuration By Policy 2021-04-14T11:12:56.165Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration By Policy" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "7c755096-e9b6-4f28-8c1e-b4aab26ae9e4" INVARIANT_UUID = "e2a07c2e-b586-41c1-86ab-24c46b5f7f95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate" CURR_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-PortMirroringConfigurationByPolicy-template.yml,0,b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b6895c40-1190-4e51-8a91-f59c25f0f6b8 EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 lock resource with id b4199ab4-d0f8-44ac-a108-8041822de48d 2021-04-14T11:12:58.098Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Port Mirroring Configuration By Policy" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "7c755096-e9b6-4f28-8c1e-b4aab26ae9e4" INVARIANT_UUID = "e2a07c2e-b586-41c1-86ab-24c46b5f7f95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscacsar" CURR_ARTIFACT_UUID = "b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-PortMirroringConfigurationByPolicy-csar.csar,0,b4199ab4-d0f8-44ac-a108-8041822de48d.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14144 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=692b167e-5dde-414e-98ff-a70bba9062b0 EntryTimestamp=2021-04-14T11:12:43.953Z InvocationID=49bc2a18-955d-4310-81b5-dfd05d994110 LogTimestamp=2021-04-14T11:12:58.097276Z ResponseDesc=Created Exiting. 2021-04-14T11:12:58.098Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:12:58.197Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=186fd399-492d-403f-9a7f-54ccf929c665 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:58.196912Z InvocationID=1b177154-4103-4c1b-82c1-98ab40b60945 LogTimestamp=2021-04-14T11:12:58.196971Z Entering 2021-04-14T11:12:58.197Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=186fd399-492d-403f-9a7f-54ccf929c665 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:12:58.196912Z InvocationID=1b177154-4103-4c1b-82c1-98ab40b60945 LogTimestamp=2021-04-14T11:12:58.196971Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:12:58.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=671b804a-e7d3-49e4-8c42-804bd64a2cc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:58.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=671b804a-e7d3-49e4-8c42-804bd64a2cc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@842d2fa 2021-04-14T11:12:58.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=671b804a-e7d3-49e4-8c42-804bd64a2cc7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:58.485Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=671b804a-e7d3-49e4-8c42-804bd64a2cc7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:12:58.875Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:58.875Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:58.875Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:58.875Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:12:58.906Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name ForwardingPath 2021-04-14T11:12:59.645Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=235ae141-139d-4f43-8325-670dce738b2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:12:59.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=235ae141-139d-4f43-8325-670dce738b2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43e8432e 2021-04-14T11:12:59.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=235ae141-139d-4f43-8325-670dce738b2c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:12:59.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=235ae141-139d-4f43-8325-670dce738b2c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:00.486Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Forwarding Path" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "ec42b064-a2b5-4524-aa8c-0cf966dab124" INVARIANT_UUID = "95d34193-29af-4549-bb5a-824d206304f1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.ForwardingPath" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ec42b064-a2b5-4524-aa8c-0cf966dab124 EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 1a344732-f801-4d19-b672-b7ee24a9735d 2021-04-14T11:13:02.084Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Forwarding Path" RESOURCE_TYPE = "ABSTRACT" SERVICE_INSTANCE_ID = "ec42b064-a2b5-4524-aa8c-0cf966dab124" INVARIANT_UUID = "95d34193-29af-4549-bb5a-824d206304f1" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1a344732-f801-4d19-b672-b7ee24a9735d.assettoscatemplate" CURR_ARTIFACT_UUID = "1a344732-f801-4d19-b672-b7ee24a9735d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ForwardingPath-template.yml,0,1a344732-f801-4d19-b672-b7ee24a9735d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=3887 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d7b66b4-fe81-452a-9409-564b7ec9edfd EntryTimestamp=2021-04-14T11:12:58.197Z InvocationID=85081a8f-0488-4ef6-a1f0-7fbf1087b0a7 LogTimestamp=2021-04-14T11:13:02.084193Z ResponseDesc=Created Exiting. 2021-04-14T11:13:02.085Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:02.097Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e43e003e-b9f9-4bbc-96a8-c561edc5d27b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:02.097282Z InvocationID=4164925f-9270-4d2b-a6ee-f1c7389a8651 LogTimestamp=2021-04-14T11:13:02.097315Z Entering 2021-04-14T11:13:02.097Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e43e003e-b9f9-4bbc-96a8-c561edc5d27b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:02.097282Z InvocationID=4164925f-9270-4d2b-a6ee-f1c7389a8651 LogTimestamp=2021-04-14T11:13:02.097315Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:02.422Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:02.422Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:02.422Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:02.422Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:02.422Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Configuration 2021-04-14T11:13:02.652Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=235ae141-139d-4f43-8325-670dce738b2c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:13:02.653Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=235ae141-139d-4f43-8325-670dce738b2c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:13:02.653Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=235ae141-139d-4f43-8325-670dce738b2c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:02.653Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=235ae141-139d-4f43-8325-670dce738b2c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b8b390-16b1-426e-9ba1-d0af41b8f038 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b8b390-16b1-426e-9ba1-d0af41b8f038 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fcbf626 2021-04-14T11:13:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b8b390-16b1-426e-9ba1-d0af41b8f038 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:03.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b8b390-16b1-426e-9ba1-d0af41b8f038 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:13:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:13:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:13:04.475Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:13:04.476Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:13:04.476Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:13:05.585Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Configuration" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "bf8338aa-fffc-490c-bf37-05bea41e765e" INVARIANT_UUID = "5996b8ed-4558-4217-8089-7303b10cf72c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.Configuration" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bf8338aa-fffc-490c-bf37-05bea41e765e EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id c4f6d336-43de-4287-84cf-a18085ed25f9 2021-04-14T11:13:06.339Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a1b8b390-16b1-426e-9ba1-d0af41b8f038 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:13:06.340Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a1b8b390-16b1-426e-9ba1-d0af41b8f038 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:13:07.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4984275-95a2-46f9-89a7-565cd01beff5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:07.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4984275-95a2-46f9-89a7-565cd01beff5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56250294 2021-04-14T11:13:07.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4984275-95a2-46f9-89a7-565cd01beff5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:07.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4984275-95a2-46f9-89a7-565cd01beff5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:08.404Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d4984275-95a2-46f9-89a7-565cd01beff5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:08.404Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d4984275-95a2-46f9-89a7-565cd01beff5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:09.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9da5d05-c1d5-487b-9589-a9f171dde0bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:09.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9da5d05-c1d5-487b-9589-a9f171dde0bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@473f6c47 2021-04-14T11:13:09.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9da5d05-c1d5-487b-9589-a9f171dde0bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:09.333Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9da5d05-c1d5-487b-9589-a9f171dde0bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:09.340Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Configuration" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "bf8338aa-fffc-490c-bf37-05bea41e765e" INVARIANT_UUID = "5996b8ed-4558-4217-8089-7303b10cf72c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c4f6d336-43de-4287-84cf-a18085ed25f9.assettoscatemplate" CURR_ARTIFACT_UUID = "c4f6d336-43de-4287-84cf-a18085ed25f9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Configuration-template.yml,0,c4f6d336-43de-4287-84cf-a18085ed25f9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" ResponseCode=201 RequestID=null ElapsedTime=7242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9a0cc74f-5f55-4c1b-ab5f-7e12f204dee6 EntryTimestamp=2021-04-14T11:13:02.097Z InvocationID=49a38043-e776-4356-8e77-a4d940a3aac7 LogTimestamp=2021-04-14T11:13:09.339717Z ResponseDesc=Created Exiting. 2021-04-14T11:13:09.341Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:09.534Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1727dc72-1200-4f58-9300-d84333869041 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:09.534276Z InvocationID=f321c903-e4bd-48e0-b5f9-1f26be601855 LogTimestamp=2021-04-14T11:13:09.534392Z Entering 2021-04-14T11:13:09.534Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1727dc72-1200-4f58-9300-d84333869041 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:09.534276Z InvocationID=f321c903-e4bd-48e0-b5f9-1f26be601855 LogTimestamp=2021-04-14T11:13:09.534392Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:11.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fee1ce73-f095-483e-baf9-deda207ec0e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:11.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fee1ce73-f095-483e-baf9-deda207ec0e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@790c2d85 2021-04-14T11:13:11.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fee1ce73-f095-483e-baf9-deda207ec0e2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:11.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fee1ce73-f095-483e-baf9-deda207ec0e2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@743a192 2021-04-14T11:13:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:12.825Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:12.825Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:12.825Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:12.825Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:12.835Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VrfObjectConfiguration 2021-04-14T11:13:14.896Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VRF Object Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "1a704f88-02ee-4790-bee1-323bf783956b" INVARIANT_UUID = "6906ac14-d71e-48af-be1b-091a2996d28e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.VRFObject" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a704f88-02ee-4790-bee1-323bf783956b EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 41de3649-1868-4ad9-a606-0839c2e1674c 2021-04-14T11:13:15.117Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:13:15.118Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:13:15.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:15.119Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=96f2fbad-7977-440a-adc5-3e60679bc019 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:15.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1760f862-dd27-4c6a-b854-4a60beb40602 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:15.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1760f862-dd27-4c6a-b854-4a60beb40602 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e3d1495 2021-04-14T11:13:15.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1760f862-dd27-4c6a-b854-4a60beb40602 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:15.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1760f862-dd27-4c6a-b854-4a60beb40602 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:16.810Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Object Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "1a704f88-02ee-4790-bee1-323bf783956b" INVARIANT_UUID = "6906ac14-d71e-48af-be1b-091a2996d28e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate" CURR_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VrfObjectConfiguration-template.yml,0,41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e6521a23-53f1-4525-9b5c-7ccf940bc37c EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Starting to create Csar for component VRF Object Configuration 2021-04-14T11:13:17.067Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Object Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "1a704f88-02ee-4790-bee1-323bf783956b" INVARIANT_UUID = "6906ac14-d71e-48af-be1b-091a2996d28e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate" CURR_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VrfObjectConfiguration-template.yml,0,41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e6521a23-53f1-4525-9b5c-7ccf940bc37c EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc Ended create Csar for component VRF Object Configuration 2021-04-14T11:13:17.067Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Object Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "1a704f88-02ee-4790-bee1-323bf783956b" INVARIANT_UUID = "6906ac14-d71e-48af-be1b-091a2996d28e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate" CURR_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VrfObjectConfiguration-template.yml,0,41de3649-1868-4ad9-a606-0839c2e1674c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e6521a23-53f1-4525-9b5c-7ccf940bc37c EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc lock resource with id 41de3649-1868-4ad9-a606-0839c2e1674c 2021-04-14T11:13:18.731Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Object Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "1a704f88-02ee-4790-bee1-323bf783956b" INVARIANT_UUID = "6906ac14-d71e-48af-be1b-091a2996d28e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscacsar" CURR_ARTIFACT_UUID = "41de3649-1868-4ad9-a606-0839c2e1674c.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VrfObjectConfiguration-csar.csar,0,41de3649-1868-4ad9-a606-0839c2e1674c.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9196 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=98789714-b249-4c9d-b8da-07fafd926405 EntryTimestamp=2021-04-14T11:13:09.535Z InvocationID=d8446be1-2191-4433-8029-3b9ce10a16fc LogTimestamp=2021-04-14T11:13:18.731376Z ResponseDesc=Created Exiting. 2021-04-14T11:13:18.732Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:18.749Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a7b74039-a19e-42d9-8a13-73ad18c37359 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:18.749033Z InvocationID=446a4c36-b651-4872-aa90-1d51b62035a4 LogTimestamp=2021-04-14T11:13:18.749109Z Entering 2021-04-14T11:13:18.749Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a7b74039-a19e-42d9-8a13-73ad18c37359 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:18.749033Z InvocationID=446a4c36-b651-4872-aa90-1d51b62035a4 LogTimestamp=2021-04-14T11:13:18.749109Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:19.013Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:19.013Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:19.013Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:19.013Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:19.022Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Extvirtualmachineinterfacecp 2021-04-14T11:13:20.200Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extVirtualMachineInterfaceCP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ee408c64-8ef9-40d0-bc80-9c7e787cd839 EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:13:20.200Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extVirtualMachineInterfaceCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ee408c64-8ef9-40d0-bc80-9c7e787cd839 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:13:20.353Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.v2.extVirtualMachineInterfaceCP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ee408c64-8ef9-40d0-bc80-9c7e787cd839 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 ErrorCode=500 lock resource with id cea57e20-4172-4420-8aa9-fd2f4cdb4b78 2021-04-14T11:13:21.189Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1760f862-dd27-4c6a-b854-4a60beb40602 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:21.189Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1760f862-dd27-4c6a-b854-4a60beb40602 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:21.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:21.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5aa47f8a 2021-04-14T11:13:21.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:21.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:21.931Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate" CURR_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extvirtualmachineinterfacecp-template.yml,0,cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=504cd7e0-59e2-41a4-9819-5c1e07a7a827 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 ErrorCode=500 Starting to create Csar for component extVirtualMachineInterfaceCP 2021-04-14T11:13:22.113Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate" CURR_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extvirtualmachineinterfacecp-template.yml,0,cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=504cd7e0-59e2-41a4-9819-5c1e07a7a827 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 ErrorCode=500 Ended create Csar for component extVirtualMachineInterfaceCP 2021-04-14T11:13:22.114Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate" CURR_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Extvirtualmachineinterfacecp-template.yml,0,cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=504cd7e0-59e2-41a4-9819-5c1e07a7a827 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 ErrorCode=500 lock resource with id cea57e20-4172-4420-8aa9-fd2f4cdb4b78 2021-04-14T11:13:23.837Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "extVirtualMachineInterfaceCP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "ee408c64-8ef9-40d0-bc80-9c7e787cd839" INVARIANT_UUID = "240f2589-c035-4c99-933d-d7d43f5e3e1e" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscacsar" CURR_ARTIFACT_UUID = "cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Extvirtualmachineinterfacecp-csar.csar,0,cea57e20-4172-4420-8aa9-fd2f4cdb4b78.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=5088 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=001a4fd0-5433-4f39-8fa4-df5a932156e9 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:18.749Z InvocationID=25f1ebe6-c2fe-42ba-a6dc-64ee930ea242 ErrorCode=500 LogTimestamp=2021-04-14T11:13:23.837019Z ResponseDesc=Created Exiting. 2021-04-14T11:13:23.837Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:23.851Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=298acb5b-3ebd-4b64-a03b-97979a06aa81 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:23.851644Z InvocationID=538cdc36-8ce3-4190-98d2-1ff736be4c5b LogTimestamp=2021-04-14T11:13:23.851686Z Entering 2021-04-14T11:13:23.851Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=298acb5b-3ebd-4b64-a03b-97979a06aa81 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:23.851644Z InvocationID=538cdc36-8ce3-4190-98d2-1ff736be4c5b LogTimestamp=2021-04-14T11:13:23.851686Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:24.362Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:13:24.362Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:13:24.362Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:24.362Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d0760110-1ea4-4ebd-9a1c-46991f30ff7c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:25.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2d7467d-3be4-4176-a211-4502ff24d852 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:25.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2d7467d-3be4-4176-a211-4502ff24d852 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40710a7d 2021-04-14T11:13:25.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2d7467d-3be4-4176-a211-4502ff24d852 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:25.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2d7467d-3be4-4176-a211-4502ff24d852 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:27.383Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b2d7467d-3be4-4176-a211-4502ff24d852 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:27.383Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b2d7467d-3be4-4176-a211-4502ff24d852 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:27.513Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:27.513Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:27.513Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:27.513Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:27.784Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VlanNetworkReceptorConfiguration 2021-04-14T11:13:28.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:28.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@749269ce 2021-04-14T11:13:28.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:28.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:31.053Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:13:31.053Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:13:31.053Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:31.053Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=95c38fae-e1c9-45be-95c5-d84cd3d4097c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:31.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c09705-dc2b-4064-8704-2f5ceb7a0b51 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:31.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c09705-dc2b-4064-8704-2f5ceb7a0b51 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@db300f9 2021-04-14T11:13:31.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c09705-dc2b-4064-8704-2f5ceb7a0b51 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:31.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c09705-dc2b-4064-8704-2f5ceb7a0b51 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:32.627Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VLAN Network Receptor Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "c87efa4a-e715-4c6f-a601-8ebf06cf4263" INVARIANT_UUID = "3ce1a8d3-3931-40c1-838e-c1b94f6ed05d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.VLANNetworkReceptor" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c87efa4a-e715-4c6f-a601-8ebf06cf4263 EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 0af7d587-3a82-4767-91df-f0ae24b0abf8 2021-04-14T11:13:34.330Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VLAN Network Receptor Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "c87efa4a-e715-4c6f-a601-8ebf06cf4263" INVARIANT_UUID = "3ce1a8d3-3931-40c1-838e-c1b94f6ed05d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate" CURR_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlanNetworkReceptorConfiguration-template.yml,0,0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fdef5e35-2162-4005-a3b1-0a9f0415d09e EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Starting to create Csar for component VLAN Network Receptor Configuration 2021-04-14T11:13:34.537Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VLAN Network Receptor Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "c87efa4a-e715-4c6f-a601-8ebf06cf4263" INVARIANT_UUID = "3ce1a8d3-3931-40c1-838e-c1b94f6ed05d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate" CURR_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlanNetworkReceptorConfiguration-template.yml,0,0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fdef5e35-2162-4005-a3b1-0a9f0415d09e EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf Ended create Csar for component VLAN Network Receptor Configuration 2021-04-14T11:13:34.537Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VLAN Network Receptor Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "c87efa4a-e715-4c6f-a601-8ebf06cf4263" INVARIANT_UUID = "3ce1a8d3-3931-40c1-838e-c1b94f6ed05d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate" CURR_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlanNetworkReceptorConfiguration-template.yml,0,0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fdef5e35-2162-4005-a3b1-0a9f0415d09e EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf lock resource with id 0af7d587-3a82-4767-91df-f0ae24b0abf8 2021-04-14T11:13:34.926Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=49c09705-dc2b-4064-8704-2f5ceb7a0b51 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:13:34.926Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=49c09705-dc2b-4064-8704-2f5ceb7a0b51 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:13:35.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0561aea0-f1b6-4860-984e-7568407873d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:35.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0561aea0-f1b6-4860-984e-7568407873d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62ba6ad6 2021-04-14T11:13:35.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0561aea0-f1b6-4860-984e-7568407873d0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:35.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0561aea0-f1b6-4860-984e-7568407873d0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:36.412Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VLAN Network Receptor Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "c87efa4a-e715-4c6f-a601-8ebf06cf4263" INVARIANT_UUID = "3ce1a8d3-3931-40c1-838e-c1b94f6ed05d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscacsar" CURR_ARTIFACT_UUID = "0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VlanNetworkReceptorConfiguration-csar.csar,0,0af7d587-3a82-4767-91df-f0ae24b0abf8.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=12557 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e2436525-5ad8-494c-acf7-a26fca9b38cf EntryTimestamp=2021-04-14T11:13:23.852Z InvocationID=a026594e-5761-4105-9054-f7b66cd197cf LogTimestamp=2021-04-14T11:13:36.409233Z ResponseDesc=Created Exiting. 2021-04-14T11:13:36.415Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:36.492Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4cb94b16-e543-49c6-a402-0d4535db2cd9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:36.492499Z InvocationID=ae702cff-c7d5-4f27-8b70-6b2f8d309c9e LogTimestamp=2021-04-14T11:13:36.492544Z Entering 2021-04-14T11:13:36.492Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4cb94b16-e543-49c6-a402-0d4535db2cd9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:36.492499Z InvocationID=ae702cff-c7d5-4f27-8b70-6b2f8d309c9e LogTimestamp=2021-04-14T11:13:36.492544Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:37.196Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:37.196Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:37.196Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:37.196Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:37.212Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VrfEntryConfiguration 2021-04-14T11:13:38.601Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0561aea0-f1b6-4860-984e-7568407873d0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:13:38.601Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0561aea0-f1b6-4860-984e-7568407873d0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:13:38.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b68c28-e69e-4d52-8860-c1aa69e3f121 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:38.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b68c28-e69e-4d52-8860-c1aa69e3f121 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10a0dfc7 2021-04-14T11:13:38.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b68c28-e69e-4d52-8860-c1aa69e3f121 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:38.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b68c28-e69e-4d52-8860-c1aa69e3f121 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:39.173Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VRF Entry Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "187fd70f-eefd-45e7-b8b5-0927da38d4b0" INVARIANT_UUID = "8bedfbb2-6ef0-4730-b335-5901e71d51c2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.VRFEntry" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=187fd70f-eefd-45e7-b8b5-0927da38d4b0 EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb 2021-04-14T11:13:40.760Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Entry Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "187fd70f-eefd-45e7-b8b5-0927da38d4b0" INVARIANT_UUID = "8bedfbb2-6ef0-4730-b335-5901e71d51c2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate" CURR_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VrfEntryConfiguration-template.yml,0,3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bd8aebf1-ee55-4209-92a4-5dfb6dbd5438 EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Starting to create Csar for component VRF Entry Configuration 2021-04-14T11:13:40.931Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Entry Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "187fd70f-eefd-45e7-b8b5-0927da38d4b0" INVARIANT_UUID = "8bedfbb2-6ef0-4730-b335-5901e71d51c2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate" CURR_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VrfEntryConfiguration-template.yml,0,3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bd8aebf1-ee55-4209-92a4-5dfb6dbd5438 EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae Ended create Csar for component VRF Entry Configuration 2021-04-14T11:13:40.932Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Entry Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "187fd70f-eefd-45e7-b8b5-0927da38d4b0" INVARIANT_UUID = "8bedfbb2-6ef0-4730-b335-5901e71d51c2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate" CURR_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VrfEntryConfiguration-template.yml,0,3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bd8aebf1-ee55-4209-92a4-5dfb6dbd5438 EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae lock resource with id 3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb 2021-04-14T11:13:42.538Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VRF Entry Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "187fd70f-eefd-45e7-b8b5-0927da38d4b0" INVARIANT_UUID = "8bedfbb2-6ef0-4730-b335-5901e71d51c2" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscacsar" CURR_ARTIFACT_UUID = "3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VrfEntryConfiguration-csar.csar,0,3f56c59d-3dce-4e78-bd5e-d57f5a64e8cb.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6044 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=07fc2ac1-85eb-4054-971d-414bda2dcc50 EntryTimestamp=2021-04-14T11:13:36.493Z InvocationID=633149c0-da0e-4df2-ac1c-0b84aef02aae LogTimestamp=2021-04-14T11:13:42.537677Z ResponseDesc=Created Exiting. 2021-04-14T11:13:42.538Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:42.559Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2c74e894-dc75-4d9d-a27c-73a4b50e87d1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:42.559228Z InvocationID=07ca5f52-c242-4300-b45d-bb2645302bae LogTimestamp=2021-04-14T11:13:42.559285Z Entering 2021-04-14T11:13:42.560Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2c74e894-dc75-4d9d-a27c-73a4b50e87d1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:42.559228Z InvocationID=07ca5f52-c242-4300-b45d-bb2645302bae LogTimestamp=2021-04-14T11:13:42.559285Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:43.424Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:43.425Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:43.425Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:43.425Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:43.516Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Subinterfacev2 2021-04-14T11:13:44.271Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=89b68c28-e69e-4d52-8860-c1aa69e3f121 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:44.271Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=89b68c28-e69e-4d52-8860-c1aa69e3f121 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5d92c-8aea-481d-93d0-6f8bd5b91da4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5d92c-8aea-481d-93d0-6f8bd5b91da4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34fade56 2021-04-14T11:13:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5d92c-8aea-481d-93d0-6f8bd5b91da4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5d92c-8aea-481d-93d0-6f8bd5b91da4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:47.833Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.v2.SubInterface" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b62efa21-202c-4703-844a-2aa61164920d EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:13:47.836Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.v2.SubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b62efa21-202c-4703-844a-2aa61164920d TargetServiceName=null EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:13:48.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e84071-f5d8-4f50-ad28-ee1d0e4d65fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:48.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e84071-f5d8-4f50-ad28-ee1d0e4d65fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@492135c0 2021-04-14T11:13:48.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e84071-f5d8-4f50-ad28-ee1d0e4d65fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:48.288Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e84071-f5d8-4f50-ad28-ee1d0e4d65fe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:50.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64bc5f51-2b9f-4538-9908-b0c7e28ef5db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:50.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64bc5f51-2b9f-4538-9908-b0c7e28ef5db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cd49a23 2021-04-14T11:13:50.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64bc5f51-2b9f-4538-9908-b0c7e28ef5db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:50.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64bc5f51-2b9f-4538-9908-b0c7e28ef5db PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:51.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:51.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d4e5f6a 2021-04-14T11:13:51.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:51.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:51.733Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.network.v2.SubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b62efa21-202c-4703-844a-2aa61164920d TargetServiceName=null EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e ErrorCode=500 lock resource with id f8cdf3ad-a06b-4aeb-8025-ed410918948c 2021-04-14T11:13:53.448Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate" CURR_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Subinterfacev2-template.yml,0,f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=db287c9e-b47e-44a7-a4c4-bec56a1dc565 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e ErrorCode=500 Starting to create Csar for component subInterfaceV2 2021-04-14T11:13:53.670Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate" CURR_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Subinterfacev2-template.yml,0,f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=db287c9e-b47e-44a7-a4c4-bec56a1dc565 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e ErrorCode=500 Ended create Csar for component subInterfaceV2 2021-04-14T11:13:53.671Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate" CURR_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Subinterfacev2-template.yml,0,f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=db287c9e-b47e-44a7-a4c4-bec56a1dc565 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e ErrorCode=500 lock resource with id f8cdf3ad-a06b-4aeb-8025-ed410918948c 2021-04-14T11:13:54.637Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:13:54.638Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:13:54.638Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:54.638Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f946fc3a-d569-49bd-bf35-e44f5445af85 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:55.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71b5286d-7b80-4951-8e20-b0af0310f4d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:55.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71b5286d-7b80-4951-8e20-b0af0310f4d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f2422fb 2021-04-14T11:13:55.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71b5286d-7b80-4951-8e20-b0af0310f4d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:55.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71b5286d-7b80-4951-8e20-b0af0310f4d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:55.799Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "subInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "b62efa21-202c-4703-844a-2aa61164920d" INVARIANT_UUID = "8c3b4d8e-07d6-48cf-996b-d6df5d19d740" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscacsar" CURR_ARTIFACT_UUID = "f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Subinterfacev2-csar.csar,0,f8cdf3ad-a06b-4aeb-8025-ed410918948c.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13239 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=61603667-f275-4dcd-9ff9-7a7312c187e6 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:42.560Z InvocationID=c0059bff-4442-44c7-9895-1b02a067e87e ErrorCode=500 LogTimestamp=2021-04-14T11:13:55.799327Z ResponseDesc=Created Exiting. 2021-04-14T11:13:55.800Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:13:55.889Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=84295b5e-86f4-495e-8e8e-633bfdd354e5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:55.888982Z InvocationID=e5aed5ab-4428-47bd-b29d-12b5dc76ab12 LogTimestamp=2021-04-14T11:13:55.889045Z Entering 2021-04-14T11:13:55.889Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=84295b5e-86f4-495e-8e8e-633bfdd354e5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:13:55.888982Z InvocationID=e5aed5ab-4428-47bd-b29d-12b5dc76ab12 LogTimestamp=2021-04-14T11:13:55.889045Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:13:56.899Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:56.899Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:56.899Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:56.899Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:13:56.907Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=71b5286d-7b80-4951-8e20-b0af0310f4d4 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:56.907Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=71b5286d-7b80-4951-8e20-b0af0310f4d4 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:13:57.012Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Contrailv2vlansubinterfacev2 2021-04-14T11:13:57.308Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:13:57.308Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37a607a6 2021-04-14T11:13:57.308Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:13:57.308Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:13:59.117Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.v2.contrailV2.VLANSubInterface" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d136a1d3-ab12-49c5-b227-bf3583e781a8 EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:13:59.118Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.v2.contrailV2.VLANSubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d136a1d3-ab12-49c5-b227-bf3583e781a8 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:13:59.352Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.nodes.heat.network.v2.contrailV2.VLANSubInterface" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d136a1d3-ab12-49c5-b227-bf3583e781a8 TargetServiceName=null EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 ErrorCode=500 lock resource with id 6291eb12-495c-4af4-bcc3-b3a76eac7f50 2021-04-14T11:14:00.313Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:14:00.314Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:14:00.314Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:00.314Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=287d48a0-67b8-451f-8920-079c04fa9dfb ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:00.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94cab2b-ff6b-425a-ba52-fde05a4053be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:00.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94cab2b-ff6b-425a-ba52-fde05a4053be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18bcab37 2021-04-14T11:14:00.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94cab2b-ff6b-425a-ba52-fde05a4053be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:00.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94cab2b-ff6b-425a-ba52-fde05a4053be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:00.958Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate" CURR_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2vlansubinterfacev2-template.yml,0,6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fbf418da-8208-48da-aee2-add205ddf30c TargetServiceName=null EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 ErrorCode=500 Starting to create Csar for component contrailV2VLANSubInterfaceV2 2021-04-14T11:14:01.136Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate" CURR_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2vlansubinterfacev2-template.yml,0,6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fbf418da-8208-48da-aee2-add205ddf30c TargetServiceName=null EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 ErrorCode=500 Ended create Csar for component contrailV2VLANSubInterfaceV2 2021-04-14T11:14:01.136Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate" CURR_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Contrailv2vlansubinterfacev2-template.yml,0,6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fbf418da-8208-48da-aee2-add205ddf30c TargetServiceName=null EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 ErrorCode=500 lock resource with id 6291eb12-495c-4af4-bcc3-b3a76eac7f50 2021-04-14T11:14:02.825Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "contrailV2VLANSubInterfaceV2" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d136a1d3-ab12-49c5-b227-bf3583e781a8" INVARIANT_UUID = "3514d2d2-bff0-4cd2-ba96-3cb17d7f1c05" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscacsar" CURR_ARTIFACT_UUID = "6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Contrailv2vlansubinterfacev2-csar.csar,0,6291eb12-495c-4af4-bcc3-b3a76eac7f50.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6934 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=526a54c0-c883-4a99-951c-d5c879c09dfe TargetServiceName=null EntryTimestamp=2021-04-14T11:13:55.890Z InvocationID=bf601c6b-8f63-480a-9eff-6f40a1bb21c0 ErrorCode=500 LogTimestamp=2021-04-14T11:14:02.824910Z ResponseDesc=Created Exiting. 2021-04-14T11:14:02.826Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:14:02.917Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4be2e907-290f-447d-ac60-232e7ec1f2c9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:02.916864Z InvocationID=30ee31de-5d87-4ba0-af3a-710c543a4dc8 LogTimestamp=2021-04-14T11:14:02.916914Z Entering 2021-04-14T11:14:02.917Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4be2e907-290f-447d-ac60-232e7ec1f2c9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:02.916864Z InvocationID=30ee31de-5d87-4ba0-af3a-710c543a4dc8 LogTimestamp=2021-04-14T11:14:02.916914Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:14:03.738Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:03.738Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:03.738Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:03.738Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:03.748Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name FabricConfiguration 2021-04-14T11:14:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:14:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:14:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:14:06.920Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:14:06.920Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:14:06.923Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:14:06.923Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:14:06.929Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:14:06.929Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:14:06.936Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:14:06.937Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:14:06.937Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:14:07.753Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c94cab2b-ff6b-425a-ba52-fde05a4053be ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:07.753Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c94cab2b-ff6b-425a-ba52-fde05a4053be ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:08.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9910b12-cc7e-43c5-a793-8776a1c4b79d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:08.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9910b12-cc7e-43c5-a793-8776a1c4b79d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2526bad6 2021-04-14T11:14:08.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9910b12-cc7e-43c5-a793-8776a1c4b79d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:08.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9910b12-cc7e-43c5-a793-8776a1c4b79d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:10.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6b6428-2378-4d16-b8fd-4176f61c5dba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:10.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6b6428-2378-4d16-b8fd-4176f61c5dba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@223a02e3 2021-04-14T11:14:10.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6b6428-2378-4d16-b8fd-4176f61c5dba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:10.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6b6428-2378-4d16-b8fd-4176f61c5dba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:11.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fc6c849-03b1-4709-b0c7-3d439c40712f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:11.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fc6c849-03b1-4709-b0c7-3d439c40712f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f22f080 2021-04-14T11:14:11.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fc6c849-03b1-4709-b0c7-3d439c40712f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:11.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fc6c849-03b1-4709-b0c7-3d439c40712f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:12.436Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Fabric Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "e347a9fa-1a0e-490b-baf8-0dccb92762a2" INVARIANT_UUID = "9b1f0081-e170-460c-b0e3-135a17f53419" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.nodes.FabricConfiguration" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e347a9fa-1a0e-490b-baf8-0dccb92762a2 EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id cfd9640b-7531-41c2-9b68-21042088b7c5 2021-04-14T11:14:13.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2680ce59-b38e-44bb-834f-dde395dd6aa2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:13.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2680ce59-b38e-44bb-834f-dde395dd6aa2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52379a2c 2021-04-14T11:14:13.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2680ce59-b38e-44bb-834f-dde395dd6aa2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:13.517Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2680ce59-b38e-44bb-834f-dde395dd6aa2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6fcc809-2f94-46f0-8d6e-b5d727145f0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6fcc809-2f94-46f0-8d6e-b5d727145f0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42577ab6 2021-04-14T11:14:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6fcc809-2f94-46f0-8d6e-b5d727145f0b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6fcc809-2f94-46f0-8d6e-b5d727145f0b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:14.913Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Fabric Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "e347a9fa-1a0e-490b-baf8-0dccb92762a2" INVARIANT_UUID = "9b1f0081-e170-460c-b0e3-135a17f53419" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate" CURR_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-FabricConfiguration-template.yml,0,cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a04d2043-eaef-4482-bc06-6664bd4e58b5 EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Starting to create Csar for component Fabric Configuration 2021-04-14T11:14:15.285Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Fabric Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "e347a9fa-1a0e-490b-baf8-0dccb92762a2" INVARIANT_UUID = "9b1f0081-e170-460c-b0e3-135a17f53419" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate" CURR_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-FabricConfiguration-template.yml,0,cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a04d2043-eaef-4482-bc06-6664bd4e58b5 EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c Ended create Csar for component Fabric Configuration 2021-04-14T11:14:15.285Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Fabric Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "e347a9fa-1a0e-490b-baf8-0dccb92762a2" INVARIANT_UUID = "9b1f0081-e170-460c-b0e3-135a17f53419" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate" CURR_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-FabricConfiguration-template.yml,0,cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a04d2043-eaef-4482-bc06-6664bd4e58b5 EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c lock resource with id cfd9640b-7531-41c2-9b68-21042088b7c5 2021-04-14T11:14:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30884505 2021-04-14T11:14:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:16.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:17.231Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Fabric Configuration" RESOURCE_TYPE = "Configuration" SERVICE_INSTANCE_ID = "e347a9fa-1a0e-490b-baf8-0dccb92762a2" INVARIANT_UUID = "9b1f0081-e170-460c-b0e3-135a17f53419" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscacsar" CURR_ARTIFACT_UUID = "cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-FabricConfiguration-csar.csar,0,cfd9640b-7531-41c2-9b68-21042088b7c5.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14314 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2c5d2d2e-f12b-4491-97ad-6baf02d42af5 EntryTimestamp=2021-04-14T11:14:02.917Z InvocationID=989f97b6-f92f-45c8-a316-728a8c8e1d8c LogTimestamp=2021-04-14T11:14:17.231229Z ResponseDesc=Created Exiting. 2021-04-14T11:14:17.231Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:14:17.291Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2e2adf41-f776-48af-8ed9-a8378c3a7812 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:17.288489Z InvocationID=d3948c6b-eaf1-4f49-a1ef-51c927a16dd5 LogTimestamp=2021-04-14T11:14:17.288539Z Entering 2021-04-14T11:14:17.292Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2e2adf41-f776-48af-8ed9-a8378c3a7812 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:17.288489Z InvocationID=d3948c6b-eaf1-4f49-a1ef-51c927a16dd5 LogTimestamp=2021-04-14T11:14:17.288539Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:14:18.186Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:18.186Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:18.186Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:18.186Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:18.205Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VlUnderlayvpn 2021-04-14T11:14:19.021Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:14:19.022Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:14:19.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:19.022Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=998b946b-3a57-4dfa-a96f-a8bb13b0cfc0 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:19.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571da5ff-7ae8-4152-97db-4f1bcdd86c22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:19.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571da5ff-7ae8-4152-97db-4f1bcdd86c22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78e60564 2021-04-14T11:14:19.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571da5ff-7ae8-4152-97db-4f1bcdd86c22 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:19.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=571da5ff-7ae8-4152-97db-4f1bcdd86c22 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:19.490Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.underlayvpn" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bf101b0b-1377-404e-89e1-1725cb51154c EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:14:19.491Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.underlayvpn" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bf101b0b-1377-404e-89e1-1725cb51154c TargetServiceName=null EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:14:19.714Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.underlayvpn" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bf101b0b-1377-404e-89e1-1725cb51154c TargetServiceName=null EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 ErrorCode=500 lock resource with id 776d3b77-fd1a-4cde-8c16-60469b636d90 2021-04-14T11:14:21.302Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate" CURR_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlUnderlayvpn-template.yml,0,776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7932744b-4890-4a61-a396-c78e40d56d1a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 ErrorCode=500 Starting to create Csar for component VL UNDERLAYVPN 2021-04-14T11:14:21.481Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate" CURR_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlUnderlayvpn-template.yml,0,776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7932744b-4890-4a61-a396-c78e40d56d1a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 ErrorCode=500 Ended create Csar for component VL UNDERLAYVPN 2021-04-14T11:14:21.481Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate" CURR_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlUnderlayvpn-template.yml,0,776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7932744b-4890-4a61-a396-c78e40d56d1a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 ErrorCode=500 lock resource with id 776d3b77-fd1a-4cde-8c16-60469b636d90 2021-04-14T11:14:22.229Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=571da5ff-7ae8-4152-97db-4f1bcdd86c22 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:14:22.229Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=571da5ff-7ae8-4152-97db-4f1bcdd86c22 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:14:22.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4064ec-3527-4ecf-8461-3307937b476f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:22.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4064ec-3527-4ecf-8461-3307937b476f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f155c1f 2021-04-14T11:14:22.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4064ec-3527-4ecf-8461-3307937b476f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:22.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c4064ec-3527-4ecf-8461-3307937b476f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:23.219Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL UNDERLAYVPN" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "bf101b0b-1377-404e-89e1-1725cb51154c" INVARIANT_UUID = "ab84066d-de0e-460f-84d6-1185b07602d5" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscacsar" CURR_ARTIFACT_UUID = "776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VlUnderlayvpn-csar.csar,0,776d3b77-fd1a-4cde-8c16-60469b636d90.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=5927 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ba1b060a-a42a-458e-92d3-7fbc6f6a8540 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:17.292Z InvocationID=037017a6-d2de-4278-a9dc-fea9656afde6 ErrorCode=500 LogTimestamp=2021-04-14T11:14:23.219140Z ResponseDesc=Created Exiting. 2021-04-14T11:14:23.219Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:14:23.237Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2abb54c0-294d-4158-9aaf-398382005e71 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:23.236870Z InvocationID=ac66ea36-cafc-4204-b68c-1fbb4833857f LogTimestamp=2021-04-14T11:14:23.236911Z Entering 2021-04-14T11:14:23.237Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2abb54c0-294d-4158-9aaf-398382005e71 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:23.236870Z InvocationID=ac66ea36-cafc-4204-b68c-1fbb4833857f LogTimestamp=2021-04-14T11:14:23.236911Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:14:24.236Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:24.236Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:24.236Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:24.236Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:24.410Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VlOverlaytunnel 2021-04-14T11:14:25.740Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8c4064ec-3527-4ecf-8461-3307937b476f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:14:25.740Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8c4064ec-3527-4ecf-8461-3307937b476f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:14:26.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25e70f3a-2a90-491b-8450-e57a52124532 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:26.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25e70f3a-2a90-491b-8450-e57a52124532 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55c2677c 2021-04-14T11:14:26.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25e70f3a-2a90-491b-8450-e57a52124532 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:26.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25e70f3a-2a90-491b-8450-e57a52124532 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:29.010Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.overlaytunnel" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=aeb66c84-e74c-4577-a668-49052248433c EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:14:29.011Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.overlaytunnel" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=aeb66c84-e74c-4577-a668-49052248433c TargetServiceName=null EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:14:31.136Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.overlaytunnel" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=aeb66c84-e74c-4577-a668-49052248433c TargetServiceName=null EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 ErrorCode=500 lock resource with id 004451aa-4e86-4203-9757-e9e93116323f 2021-04-14T11:14:31.168Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=25e70f3a-2a90-491b-8450-e57a52124532 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:31.168Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=25e70f3a-2a90-491b-8450-e57a52124532 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:14:31.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d8be6a-567e-4f36-b5ac-3457437bd5bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:31.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d8be6a-567e-4f36-b5ac-3457437bd5bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76cf87d8 2021-04-14T11:14:31.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d8be6a-567e-4f36-b5ac-3457437bd5bd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:31.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d8be6a-567e-4f36-b5ac-3457437bd5bd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:33.117Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate" CURR_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlOverlaytunnel-template.yml,0,004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d054622b-254d-4736-bfd9-af94f2b2c715 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 ErrorCode=500 Starting to create Csar for component VL OVERLAYTUNNEL 2021-04-14T11:14:33.296Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate" CURR_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlOverlaytunnel-template.yml,0,004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d054622b-254d-4736-bfd9-af94f2b2c715 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 ErrorCode=500 Ended create Csar for component VL OVERLAYTUNNEL 2021-04-14T11:14:33.296Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate" CURR_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VlOverlaytunnel-template.yml,0,004451aa-4e86-4203-9757-e9e93116323f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d054622b-254d-4736-bfd9-af94f2b2c715 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 ErrorCode=500 lock resource with id 004451aa-4e86-4203-9757-e9e93116323f 2021-04-14T11:14:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbd8ccd4-5eb0-43d2-b26b-53d36951aa4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbd8ccd4-5eb0-43d2-b26b-53d36951aa4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57cd8eb0 2021-04-14T11:14:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbd8ccd4-5eb0-43d2-b26b-53d36951aa4c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:33.323Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbd8ccd4-5eb0-43d2-b26b-53d36951aa4c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:35.112Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VL OVERLAYTUNNEL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "aeb66c84-e74c-4577-a668-49052248433c" INVARIANT_UUID = "75a2744b-ed67-46c0-8a4d-d223dcb548e8" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscacsar" CURR_ARTIFACT_UUID = "004451aa-4e86-4203-9757-e9e93116323f.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VlOverlaytunnel-csar.csar,0,004451aa-4e86-4203-9757-e9e93116323f.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=11875 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e3154f0d-7f20-498f-8e78-07b74cf3dac0 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:23.237Z InvocationID=fe6577e6-386a-4e54-b560-4d76edeca1d4 ErrorCode=500 LogTimestamp=2021-04-14T11:14:35.112349Z ResponseDesc=Created Exiting. 2021-04-14T11:14:35.113Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:14:35.186Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=63833e07-c0c4-42fa-88f9-2f10e9db395a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:35.186416Z InvocationID=e286dffb-0fef-41c0-b79a-5f4ae675c703 LogTimestamp=2021-04-14T11:14:35.186490Z Entering 2021-04-14T11:14:35.186Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=63833e07-c0c4-42fa-88f9-2f10e9db395a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:35.186416Z InvocationID=e286dffb-0fef-41c0-b79a-5f4ae675c703 LogTimestamp=2021-04-14T11:14:35.186490Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:14:35.305Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccec2976-d245-479b-ad12-bb5b5dfa9ece PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:35.305Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccec2976-d245-479b-ad12-bb5b5dfa9ece PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1172fab2 2021-04-14T11:14:35.305Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccec2976-d245-479b-ad12-bb5b5dfa9ece PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:35.305Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccec2976-d245-479b-ad12-bb5b5dfa9ece PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:37.286Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:37.286Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:37.286Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:37.286Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:37.300Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name GenericNeutronnet 2021-04-14T11:14:38.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44d50729-0cd3-4d04-ac42-525205cbe87a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:38.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44d50729-0cd3-4d04-ac42-525205cbe87a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c40b720 2021-04-14T11:14:38.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44d50729-0cd3-4d04-ac42-525205cbe87a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:38.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44d50729-0cd3-4d04-ac42-525205cbe87a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:39.954Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.GenericNeutronNet" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=730aee0e-48e8-4c65-8ee2-ad446a948a9d EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:14:39.955Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.GenericNeutronNet" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=730aee0e-48e8-4c65-8ee2-ad446a948a9d TargetServiceName=null EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:14:40.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b191ad2-d103-47cb-a405-d7b1d96dce04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:40.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b191ad2-d103-47cb-a405-d7b1d96dce04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56bb1a37 2021-04-14T11:14:40.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b191ad2-d103-47cb-a405-d7b1d96dce04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:40.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b191ad2-d103-47cb-a405-d7b1d96dce04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:40.653Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vl.GenericNeutronNet" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=730aee0e-48e8-4c65-8ee2-ad446a948a9d TargetServiceName=null EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c ErrorCode=500 lock resource with id b6069b7d-78a5-4d96-bf18-54f1c04f944b 2021-04-14T11:14:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80eeab1a-1e46-44a8-921e-71ac26f95310 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80eeab1a-1e46-44a8-921e-71ac26f95310 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d38b65e 2021-04-14T11:14:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80eeab1a-1e46-44a8-921e-71ac26f95310 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80eeab1a-1e46-44a8-921e-71ac26f95310 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:41.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ac81d1-5ce4-4e2b-b356-ba62b46307c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:41.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ac81d1-5ce4-4e2b-b356-ba62b46307c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b196621 2021-04-14T11:14:41.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ac81d1-5ce4-4e2b-b356-ba62b46307c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:41.346Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71ac81d1-5ce4-4e2b-b356-ba62b46307c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:41.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ef436a-0fd3-4824-a05c-941d09cd54c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:41.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ef436a-0fd3-4824-a05c-941d09cd54c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@323925d5 2021-04-14T11:14:41.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ef436a-0fd3-4824-a05c-941d09cd54c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:41.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72ef436a-0fd3-4824-a05c-941d09cd54c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:42.160Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba028a45-9c56-4bd0-8509-74f5693a75c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:42.160Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba028a45-9c56-4bd0-8509-74f5693a75c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c5dfb07 2021-04-14T11:14:42.161Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba028a45-9c56-4bd0-8509-74f5693a75c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:42.161Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba028a45-9c56-4bd0-8509-74f5693a75c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:42.327Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate" CURR_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericNeutronnet-template.yml,0,b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=011c1d64-8dd2-4957-956f-a414fcb0d0b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c ErrorCode=500 Starting to create Csar for component Generic NeutronNet 2021-04-14T11:14:42.547Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate" CURR_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericNeutronnet-template.yml,0,b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=011c1d64-8dd2-4957-956f-a414fcb0d0b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c ErrorCode=500 Ended create Csar for component Generic NeutronNet 2021-04-14T11:14:42.548Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate" CURR_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-GenericNeutronnet-template.yml,0,b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=011c1d64-8dd2-4957-956f-a414fcb0d0b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c ErrorCode=500 lock resource with id b6069b7d-78a5-4d96-bf18-54f1c04f944b 2021-04-14T11:14:44.345Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Generic NeutronNet" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "730aee0e-48e8-4c65-8ee2-ad446a948a9d" INVARIANT_UUID = "3d7ac1db-2649-49aa-ad59-6a6890c0625f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscacsar" CURR_ARTIFACT_UUID = "b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-GenericNeutronnet-csar.csar,0,b6069b7d-78a5-4d96-bf18-54f1c04f944b.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9157 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c36262f2-e022-40f6-8867-bdad237cbfdd TargetServiceName=null EntryTimestamp=2021-04-14T11:14:35.187Z InvocationID=6e8d2b51-0931-496f-8786-396961a8c22c ErrorCode=500 LogTimestamp=2021-04-14T11:14:44.344825Z ResponseDesc=Created Exiting. 2021-04-14T11:14:44.345Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:14:44.515Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=83f442c7-1e8c-4b96-9e45-bdf657676e95 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:44.514810Z InvocationID=161160b0-f0a7-4d4b-b826-48b69c3e3092 LogTimestamp=2021-04-14T11:14:44.514848Z Entering 2021-04-14T11:14:44.515Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=83f442c7-1e8c-4b96-9e45-bdf657676e95 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:44.514810Z InvocationID=161160b0-f0a7-4d4b-b826-48b69c3e3092 LogTimestamp=2021-04-14T11:14:44.514848Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:14:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc137386-5fab-49f4-a024-0e305419c7d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc137386-5fab-49f4-a024-0e305419c7d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14ff2094 2021-04-14T11:14:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc137386-5fab-49f4-a024-0e305419c7d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc137386-5fab-49f4-a024-0e305419c7d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:48.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a660bb-334b-4fa8-b7fe-aa6d08a0e236 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a660bb-334b-4fa8-b7fe-aa6d08a0e236 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34777444 2021-04-14T11:14:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a660bb-334b-4fa8-b7fe-aa6d08a0e236 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:48.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a660bb-334b-4fa8-b7fe-aa6d08a0e236 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:48.631Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:48.631Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:48.631Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:48.631Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:48.649Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Allottedresource 2021-04-14T11:14:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=426ccd10-18e9-4186-b037-e17a806b9934 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=426ccd10-18e9-4186-b037-e17a806b9934 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f1be892 2021-04-14T11:14:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=426ccd10-18e9-4186-b037-e17a806b9934 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=426ccd10-18e9-4186-b037-e17a806b9934 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:52.212Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.AllottedResource" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4a0933d5-949e-4382-b411-e79ac3e2248c EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:14:52.213Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.AllottedResource" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4a0933d5-949e-4382-b411-e79ac3e2248c TargetServiceName=null EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:14:54.231Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.AllottedResource" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4a0933d5-949e-4382-b411-e79ac3e2248c TargetServiceName=null EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf ErrorCode=500 lock resource with id 88e04db4-7d93-4eae-9c79-8de004837a46 2021-04-14T11:14:54.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049ce5e9-dd8d-4d03-b249-5f3a4e8f3eba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:54.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049ce5e9-dd8d-4d03-b249-5f3a4e8f3eba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ccda7b5 2021-04-14T11:14:54.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049ce5e9-dd8d-4d03-b249-5f3a4e8f3eba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:54.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049ce5e9-dd8d-4d03-b249-5f3a4e8f3eba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:56.936Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate" CURR_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Allottedresource-template.yml,0,88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a2bcae66-6d26-43b8-9719-2ad974813c4a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf ErrorCode=500 Starting to create Csar for component AllottedResource 2021-04-14T11:14:57.182Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate" CURR_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Allottedresource-template.yml,0,88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a2bcae66-6d26-43b8-9719-2ad974813c4a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf ErrorCode=500 Ended create Csar for component AllottedResource 2021-04-14T11:14:57.183Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate" CURR_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Allottedresource-template.yml,0,88e04db4-7d93-4eae-9c79-8de004837a46.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a2bcae66-6d26-43b8-9719-2ad974813c4a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf ErrorCode=500 lock resource with id 88e04db4-7d93-4eae-9c79-8de004837a46 2021-04-14T11:14:57.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=849a6d44-a5ba-472d-b1c4-b0fde34dc0e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:57.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=849a6d44-a5ba-472d-b1c4-b0fde34dc0e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@715bdf38 2021-04-14T11:14:57.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=849a6d44-a5ba-472d-b1c4-b0fde34dc0e2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:57.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=849a6d44-a5ba-472d-b1c4-b0fde34dc0e2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:14:59.020Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "AllottedResource" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4a0933d5-949e-4382-b411-e79ac3e2248c" INVARIANT_UUID = "c691d1d5-3768-4d29-93d0-077f4f48e065" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscacsar" CURR_ARTIFACT_UUID = "88e04db4-7d93-4eae-9c79-8de004837a46.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Allottedresource-csar.csar,0,88e04db4-7d93-4eae-9c79-8de004837a46.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14504 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5e2113d0-c91b-47f2-9c2c-1126d7ef96da TargetServiceName=null EntryTimestamp=2021-04-14T11:14:44.515Z InvocationID=77bdef1d-c9cc-4bc9-8595-b2113e2b58cf ErrorCode=500 LogTimestamp=2021-04-14T11:14:59.019532Z ResponseDesc=Created Exiting. 2021-04-14T11:14:59.020Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:14:59.093Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=62c7a692-a09b-4b43-8663-796568c42556 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:59.092761Z InvocationID=1c9e6715-35bf-4746-8458-d595d7ea7963 LogTimestamp=2021-04-14T11:14:59.092828Z Entering 2021-04-14T11:14:59.093Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=62c7a692-a09b-4b43-8663-796568c42556 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:14:59.092761Z InvocationID=1c9e6715-35bf-4746-8458-d595d7ea7963 LogTimestamp=2021-04-14T11:14:59.092828Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:14:59.419Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:59.419Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:59.419Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:59.419Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:14:59.510Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name ExtImageFile 2021-04-14T11:14:59.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edeaec1a-6811-424f-9c6f-b982cde2f62d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:14:59.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edeaec1a-6811-424f-9c6f-b982cde2f62d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e015003 2021-04-14T11:14:59.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edeaec1a-6811-424f-9c6f-b982cde2f62d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:14:59.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edeaec1a-6811-424f-9c6f-b982cde2f62d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:00.708Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.ImageFile" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=50b92aaa-5dc8-4275-8320-8891975def58 EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:15:00.710Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.ImageFile" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=50b92aaa-5dc8-4275-8320-8891975def58 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:15:00.892Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.ImageFile" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=50b92aaa-5dc8-4275-8320-8891975def58 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 ErrorCode=500 lock resource with id d0b58207-ec8d-4d11-8fc9-fd06dd44400d 2021-04-14T11:15:02.542Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate" CURR_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtImageFile-template.yml,0,d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8c94869c-837d-4a68-8caf-e9cafe3c4c14 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 ErrorCode=500 Starting to create Csar for component Ext Image File 2021-04-14T11:15:02.724Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate" CURR_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtImageFile-template.yml,0,d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8c94869c-837d-4a68-8caf-e9cafe3c4c14 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 ErrorCode=500 Ended create Csar for component Ext Image File 2021-04-14T11:15:02.724Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate" CURR_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtImageFile-template.yml,0,d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8c94869c-837d-4a68-8caf-e9cafe3c4c14 TargetServiceName=null EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 ErrorCode=500 lock resource with id d0b58207-ec8d-4d11-8fc9-fd06dd44400d 2021-04-14T11:15:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfdc5ee7-f65a-4597-9e8a-c0670bf4ec84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfdc5ee7-f65a-4597-9e8a-c0670bf4ec84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ece6829 2021-04-14T11:15:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfdc5ee7-f65a-4597-9e8a-c0670bf4ec84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfdc5ee7-f65a-4597-9e8a-c0670bf4ec84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:15:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:15:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:15:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:15:04.638Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Image File" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "50b92aaa-5dc8-4275-8320-8891975def58" INVARIANT_UUID = "aee02162-cf74-49a2-a585-dcd87341633d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscacsar" CURR_ARTIFACT_UUID = "d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-ExtImageFile-csar.csar,0,d0b58207-ec8d-4d11-8fc9-fd06dd44400d.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=5545 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b1e9323e-dac8-4b57-8c28-5061b0f0087a TargetServiceName=null EntryTimestamp=2021-04-14T11:14:59.093Z InvocationID=91c58ae3-d7a7-4fa5-8155-320f3bad5aa7 ErrorCode=500 LogTimestamp=2021-04-14T11:15:04.638430Z ResponseDesc=Created Exiting. 2021-04-14T11:15:04.639Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:15:04.715Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=06d69f5d-1483-4213-b024-f3b00a8d4f1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:04.715475Z InvocationID=1ee325cd-2174-4130-a02a-134520194383 LogTimestamp=2021-04-14T11:15:04.715538Z Entering 2021-04-14T11:15:04.715Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=06d69f5d-1483-4213-b024-f3b00a8d4f1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:04.715475Z InvocationID=1ee325cd-2174-4130-a02a-134520194383 LogTimestamp=2021-04-14T11:15:04.715538Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:15:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1318b-bfc6-4080-8f3f-c4fda85b30de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1318b-bfc6-4080-8f3f-c4fda85b30de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f4f9a4a 2021-04-14T11:15:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1318b-bfc6-4080-8f3f-c4fda85b30de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71a1318b-bfc6-4080-8f3f-c4fda85b30de PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:08.830Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:08.830Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:08.830Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:08.830Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:09.036Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name ExtLocalStorage 2021-04-14T11:15:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30422484 2021-04-14T11:15:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:09.382Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:15:09.383Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:15:09.383Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:15:12.189Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:15:12.190Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:15:12.190Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:15:12.190Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0c540a38-519b-427d-9fe3-c16eb712c455 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:15:12.827Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.LocalStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cf4d9931-0c34-4e67-a92d-17d07721194f EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:15:12.828Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.LocalStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cf4d9931-0c34-4e67-a92d-17d07721194f TargetServiceName=null EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:15:13.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223a1cdc-c9b5-446d-bd4f-f936388b09f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:13.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223a1cdc-c9b5-446d-bd4f-f936388b09f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4437fbc7 2021-04-14T11:15:13.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223a1cdc-c9b5-446d-bd4f-f936388b09f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:13.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223a1cdc-c9b5-446d-bd4f-f936388b09f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:14.061Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.LocalStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cf4d9931-0c34-4e67-a92d-17d07721194f TargetServiceName=null EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c ErrorCode=500 lock resource with id 177c6802-a115-433d-87d6-262ce4253f06 2021-04-14T11:15:15.698Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=223a1cdc-c9b5-446d-bd4f-f936388b09f6 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:15:15.698Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=223a1cdc-c9b5-446d-bd4f-f936388b09f6 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:15:16.401Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate" CURR_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtLocalStorage-template.yml,0,177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a456224-66d9-4114-b88a-4c13f8c46717 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c ErrorCode=500 Starting to create Csar for component Ext Local Storage 2021-04-14T11:15:16.732Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate" CURR_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtLocalStorage-template.yml,0,177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a456224-66d9-4114-b88a-4c13f8c46717 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c ErrorCode=500 Ended create Csar for component Ext Local Storage 2021-04-14T11:15:16.733Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate" CURR_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtLocalStorage-template.yml,0,177c6802-a115-433d-87d6-262ce4253f06.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a456224-66d9-4114-b88a-4c13f8c46717 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c ErrorCode=500 lock resource with id 177c6802-a115-433d-87d6-262ce4253f06 2021-04-14T11:15:17.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c23bc39-151f-4378-ae56-bab412a2d41d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:17.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c23bc39-151f-4378-ae56-bab412a2d41d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a5b00fc 2021-04-14T11:15:17.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c23bc39-151f-4378-ae56-bab412a2d41d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:17.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c23bc39-151f-4378-ae56-bab412a2d41d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:18.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4f8f455-5ec4-46ff-b313-9f573e5106fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:18.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4f8f455-5ec4-46ff-b313-9f573e5106fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b9c6537 2021-04-14T11:15:18.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4f8f455-5ec4-46ff-b313-9f573e5106fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:18.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4f8f455-5ec4-46ff-b313-9f573e5106fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:18.898Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Local Storage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "cf4d9931-0c34-4e67-a92d-17d07721194f" INVARIANT_UUID = "a81df8d9-8f47-438c-85ee-097297422ed3" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscacsar" CURR_ARTIFACT_UUID = "177c6802-a115-433d-87d6-262ce4253f06.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-ExtLocalStorage-csar.csar,0,177c6802-a115-433d-87d6-262ce4253f06.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14182 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b60d626a-9eda-4127-b2dd-b6c4a38c994e TargetServiceName=null EntryTimestamp=2021-04-14T11:15:04.716Z InvocationID=628b9d05-992a-4e2b-b49a-33ad6ae5256c ErrorCode=500 LogTimestamp=2021-04-14T11:15:18.898432Z ResponseDesc=Created Exiting. 2021-04-14T11:15:18.899Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:15:18.993Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ade2f40e-2d61-4150-8cf8-bfb5ca983cfd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:18.993333Z InvocationID=542ee6e5-48b1-41ee-904e-a6951c50cbb6 LogTimestamp=2021-04-14T11:15:18.993445Z Entering 2021-04-14T11:15:18.994Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ade2f40e-2d61-4150-8cf8-bfb5ca983cfd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:18.993333Z InvocationID=542ee6e5-48b1-41ee-904e-a6951c50cbb6 LogTimestamp=2021-04-14T11:15:18.993445Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:15:19.799Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:19.799Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:19.799Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:19.800Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:20.006Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name ExtZteCp 2021-04-14T11:15:20.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d541c0b-885f-4bfc-bd27-2bca32847936 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:20.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d541c0b-885f-4bfc-bd27-2bca32847936 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@608e5c40 2021-04-14T11:15:20.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d541c0b-885f-4bfc-bd27-2bca32847936 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:20.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d541c0b-885f-4bfc-bd27-2bca32847936 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:21.266Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.CP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8fbea1b4-561f-4784-855a-44e63d15cafc EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:15:21.266Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.CP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8fbea1b4-561f-4784-855a-44e63d15cafc TargetServiceName=null EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:15:21.449Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.CP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8fbea1b4-561f-4784-855a-44e63d15cafc TargetServiceName=null EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 ErrorCode=500 lock resource with id 42470412-d36d-4a2a-81ca-097d25b2c52c 2021-04-14T11:15:23.124Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate" CURR_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteCp-template.yml,0,42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8934f919-f94d-4883-9530-1d9c9fd06696 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 ErrorCode=500 Starting to create Csar for component ext ZTE CP 2021-04-14T11:15:23.475Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate" CURR_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteCp-template.yml,0,42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8934f919-f94d-4883-9530-1d9c9fd06696 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 ErrorCode=500 Ended create Csar for component ext ZTE CP 2021-04-14T11:15:23.476Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate" CURR_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteCp-template.yml,0,42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8934f919-f94d-4883-9530-1d9c9fd06696 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 ErrorCode=500 lock resource with id 42470412-d36d-4a2a-81ca-097d25b2c52c 2021-04-14T11:15:24.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52af7305-45fa-4329-bac6-695560cd1be6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:24.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52af7305-45fa-4329-bac6-695560cd1be6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13ba0b05 2021-04-14T11:15:24.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52af7305-45fa-4329-bac6-695560cd1be6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:24.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52af7305-45fa-4329-bac6-695560cd1be6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:25.755Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "8fbea1b4-561f-4784-855a-44e63d15cafc" INVARIANT_UUID = "850a8741-506e-4b6f-ace2-af6b2e50c984" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscacsar" CURR_ARTIFACT_UUID = "42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-ExtZteCp-csar.csar,0,42470412-d36d-4a2a-81ca-097d25b2c52c.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6761 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=fe08eade-19fc-4d8e-917f-d2b53146295f TargetServiceName=null EntryTimestamp=2021-04-14T11:15:18.994Z InvocationID=77c61531-f839-48ce-9d5e-06ab596a21a2 ErrorCode=500 LogTimestamp=2021-04-14T11:15:25.755064Z ResponseDesc=Created Exiting. 2021-04-14T11:15:25.756Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:15:25.835Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1a115e2f-55ac-4492-bc98-a98aabeec26a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:25.834987Z InvocationID=0982999b-3830-48d9-9501-89f106e7490d LogTimestamp=2021-04-14T11:15:25.835031Z Entering 2021-04-14T11:15:25.835Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1a115e2f-55ac-4492-bc98-a98aabeec26a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:25.834987Z InvocationID=0982999b-3830-48d9-9501-89f106e7490d LogTimestamp=2021-04-14T11:15:25.835031Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:15:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c68734e-aafb-4696-8fe4-166ad9c1d57f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c68734e-aafb-4696-8fe4-166ad9c1d57f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7104b56e 2021-04-14T11:15:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c68734e-aafb-4696-8fe4-166ad9c1d57f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c68734e-aafb-4696-8fe4-166ad9c1d57f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:30.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e8451dc-9873-429f-9b73-dbabc7cfb173 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:30.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e8451dc-9873-429f-9b73-dbabc7cfb173 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9c9c3a4 2021-04-14T11:15:30.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e8451dc-9873-429f-9b73-dbabc7cfb173 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:30.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e8451dc-9873-429f-9b73-dbabc7cfb173 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:30.729Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:30.729Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:30.729Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:30.729Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:31.646Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name ExtZteVdu 2021-04-14T11:15:33.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14582c72-a9f4-436f-8a5a-6fe1c515964b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:33.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14582c72-a9f4-436f-8a5a-6fe1c515964b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bb7e281 2021-04-14T11:15:33.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14582c72-a9f4-436f-8a5a-6fe1c515964b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:33.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14582c72-a9f4-436f-8a5a-6fe1c515964b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:15:36.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:15:37.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec706e3a-ce45-444b-baeb-537c45717847 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:37.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec706e3a-ce45-444b-baeb-537c45717847 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@589630d1 2021-04-14T11:15:37.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec706e3a-ce45-444b-baeb-537c45717847 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:37.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec706e3a-ce45-444b-baeb-537c45717847 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:37.270Z [qtp580718781-13] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VDU" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8 EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:15:37.635Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VDU" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8 EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:15:37.636Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VDU" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:15:38.931Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:15:40.005Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VDU" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c ErrorCode=500 lock resource with id 518f756f-e39c-420d-8210-1a748dcf250f 2021-04-14T11:15:40.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee868a8b-5360-4b9e-a8b7-2e1ea6ba5fc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:40.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee868a8b-5360-4b9e-a8b7-2e1ea6ba5fc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ced5168 2021-04-14T11:15:40.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee868a8b-5360-4b9e-a8b7-2e1ea6ba5fc7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:40.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee868a8b-5360-4b9e-a8b7-2e1ea6ba5fc7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:41.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0a3105-e229-406b-9cfa-02feae279017 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:41.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0a3105-e229-406b-9cfa-02feae279017 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bfe77b2 2021-04-14T11:15:41.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0a3105-e229-406b-9cfa-02feae279017 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:41.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db0a3105-e229-406b-9cfa-02feae279017 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:41.736Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate" CURR_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteVdu-template.yml,0,518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9112a9e7-2fa7-4416-9d4a-36848690e931 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c ErrorCode=500 Starting to create Csar for component Ext Zte VDU 2021-04-14T11:15:41.925Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate" CURR_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteVdu-template.yml,0,518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9112a9e7-2fa7-4416-9d4a-36848690e931 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c ErrorCode=500 Ended create Csar for component Ext Zte VDU 2021-04-14T11:15:41.925Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate" CURR_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteVdu-template.yml,0,518f756f-e39c-420d-8210-1a748dcf250f.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9112a9e7-2fa7-4416-9d4a-36848690e931 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c ErrorCode=500 lock resource with id 518f756f-e39c-420d-8210-1a748dcf250f 2021-04-14T11:15:43.633Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Ext Zte VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "0493ad9a-bb9a-47d9-b54e-c9d20dabbfe8" INVARIANT_UUID = "e518f3ff-d6a5-413b-9a6b-cdd25e466a9f" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscacsar" CURR_ARTIFACT_UUID = "518f756f-e39c-420d-8210-1a748dcf250f.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-ExtZteVdu-csar.csar,0,518f756f-e39c-420d-8210-1a748dcf250f.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=17798 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=de2801b1-9cbf-4d65-a900-68338f5a5d5c TargetServiceName=null EntryTimestamp=2021-04-14T11:15:25.835Z InvocationID=863b7602-09c2-4baa-82ea-721e260adb9c ErrorCode=500 LogTimestamp=2021-04-14T11:15:43.633395Z ResponseDesc=Created Exiting. 2021-04-14T11:15:43.634Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:15:43.717Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=28d214b3-d6f1-44bd-908d-21ceb586cfa1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:43.717484Z InvocationID=8e25e2a5-ff25-42be-9700-79053277ac4e LogTimestamp=2021-04-14T11:15:43.717565Z Entering 2021-04-14T11:15:43.718Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=28d214b3-d6f1-44bd-908d-21ceb586cfa1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:43.717484Z InvocationID=8e25e2a5-ff25-42be-9700-79053277ac4e LogTimestamp=2021-04-14T11:15:43.717565Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:15:45.119Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:45.119Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:45.119Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:45.119Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:45.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=576f7d41-2a7d-4a9e-a92f-933643768774 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:45.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=576f7d41-2a7d-4a9e-a92f-933643768774 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f7937a6 2021-04-14T11:15:45.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=576f7d41-2a7d-4a9e-a92f-933643768774 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:45.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=576f7d41-2a7d-4a9e-a92f-933643768774 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:45.239Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name ExtZteVl 2021-04-14T11:15:48.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe93837e-378b-4af4-8d8f-d6e322c89c7e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:48.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe93837e-378b-4af4-8d8f-d6e322c89c7e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6809220 2021-04-14T11:15:48.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe93837e-378b-4af4-8d8f-d6e322c89c7e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:48.431Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe93837e-378b-4af4-8d8f-d6e322c89c7e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:51.128Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VL" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=676f4255-3ffb-4762-96ad-0550a875b566 EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:15:51.129Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=676f4255-3ffb-4762-96ad-0550a875b566 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:15:51.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d9cd60-2e66-4483-90e3-ee9a598144be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:51.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d9cd60-2e66-4483-90e3-ee9a598144be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6000f589 2021-04-14T11:15:51.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d9cd60-2e66-4483-90e3-ee9a598144be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:51.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d9cd60-2e66-4483-90e3-ee9a598144be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:52.386Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c37a7af8-ed9d-487f-802c-1fc512640d70 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:52.385988Z InvocationID=2c6910f9-3287-49d2-8c86-55e0b2c975d0 LogTimestamp=2021-04-14T11:15:52.386041Z Entering 2021-04-14T11:15:52.386Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c37a7af8-ed9d-487f-802c-1fc512640d70 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:52.385988Z InvocationID=2c6910f9-3287-49d2-8c86-55e0b2c975d0 LogTimestamp=2021-04-14T11:15:52.386041Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:15:52.388Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:15:52.386Z InvocationID=b309ea0e-293f-4624-9bc6-14a6c827a889 LogTimestamp=2021-04-14T11:15:52.388045Z ResponseDesc=OK Exiting. 2021-04-14T11:15:52.388Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:15:53.313Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.ext.zte.VL" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=676f4255-3ffb-4762-96ad-0550a875b566 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 ErrorCode=500 lock resource with id c73bbf0d-0924-4610-a030-db07d535b159 2021-04-14T11:15:53.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ecfd3de-8ea7-46c0-9401-b61641b7e67a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:53.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ecfd3de-8ea7-46c0-9401-b61641b7e67a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58fb5ddc 2021-04-14T11:15:53.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ecfd3de-8ea7-46c0-9401-b61641b7e67a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:53.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ecfd3de-8ea7-46c0-9401-b61641b7e67a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:55.287Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate" CURR_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteVl-template.yml,0,c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=20780585-8841-47d4-88a0-0dce8c9e30a8 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 ErrorCode=500 Starting to create Csar for component ext ZTE VL 2021-04-14T11:15:55.496Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate" CURR_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteVl-template.yml,0,c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=20780585-8841-47d4-88a0-0dce8c9e30a8 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 ErrorCode=500 Ended create Csar for component ext ZTE VL 2021-04-14T11:15:55.496Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate" CURR_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-ExtZteVl-template.yml,0,c73bbf0d-0924-4610-a030-db07d535b159.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=20780585-8841-47d4-88a0-0dce8c9e30a8 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 ErrorCode=500 lock resource with id c73bbf0d-0924-4610-a030-db07d535b159 2021-04-14T11:15:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab83801-f91a-48da-b3f0-3410b1ea859f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab83801-f91a-48da-b3f0-3410b1ea859f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e998562 2021-04-14T11:15:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab83801-f91a-48da-b3f0-3410b1ea859f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab83801-f91a-48da-b3f0-3410b1ea859f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:15:57.499Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "ext ZTE VL" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "676f4255-3ffb-4762-96ad-0550a875b566" INVARIANT_UUID = "58988836-1bac-40fd-8b98-80c381e3ac26" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscacsar" CURR_ARTIFACT_UUID = "c73bbf0d-0924-4610-a030-db07d535b159.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-ExtZteVl-csar.csar,0,c73bbf0d-0924-4610-a030-db07d535b159.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13780 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ff1138ea-f8b2-4154-b83c-23ad1b22423b TargetServiceName=null EntryTimestamp=2021-04-14T11:15:43.718Z InvocationID=24ddadbe-d010-43b2-ba9b-c8207e892e80 ErrorCode=500 LogTimestamp=2021-04-14T11:15:57.498536Z ResponseDesc=Created Exiting. 2021-04-14T11:15:57.499Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:15:57.588Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3ecc954f-2283-4f33-946d-1492fcb00b9c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:57.587921Z InvocationID=0d2e59ac-b878-4a2a-b0e7-97dd39501681 LogTimestamp=2021-04-14T11:15:57.588039Z Entering 2021-04-14T11:15:57.588Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3ecc954f-2283-4f33-946d-1492fcb00b9c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:15:57.587921Z InvocationID=0d2e59ac-b878-4a2a-b0e7-97dd39501681 LogTimestamp=2021-04-14T11:15:57.588039Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:15:58.491Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:58.491Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:58.491Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:58.491Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:15:58.509Z [qtp580718781-16] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateLifecycleTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=400 Interface tosca.interfaces.nfv.nslcm required is missing 2021-04-14T11:15:58.509Z [qtp580718781-16] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateLifecycleTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 Operation towards database failed. 2021-04-14T11:15:58.509Z [qtp580718781-16] WARN o.o.s.e.AbstractSdncException RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=900 2021-04-14T11:15:58.513Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "400" DESC = "SVC4134: Error: Invalid Content. Missing interface life-cycle type." TOSCA_NODE_TYPE = "tosca.nodes.nfv.NS" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=900 lock resource with name Ns 2021-04-14T11:15:59.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a3640de-272a-4943-ad72-d6316fc1e2b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:15:59.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a3640de-272a-4943-ad72-d6316fc1e2b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c0a0903 2021-04-14T11:15:59.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a3640de-272a-4943-ad72-d6316fc1e2b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:15:59.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a3640de-272a-4943-ad72-d6316fc1e2b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:00.463Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NS" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=42a21c1d-d929-4b62-8590-a9f5ba0bcc75 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=900 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:16:00.464Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NS" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=42a21c1d-d929-4b62-8590-a9f5ba0bcc75 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:16:00.667Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NS" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=42a21c1d-d929-4b62-8590-a9f5ba0bcc75 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 lock resource with id a41f70e0-86fa-40b9-8f79-b3a841b87277 2021-04-14T11:16:02.266Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=50f7c663-c189-4ba9-9710-c9909037bd39 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 Starting to create Csar for component NS 2021-04-14T11:16:02.520Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=50f7c663-c189-4ba9-9710-c9909037bd39 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 Ended create Csar for component NS 2021-04-14T11:16:02.520Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=50f7c663-c189-4ba9-9710-c9909037bd39 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 lock resource with id a41f70e0-86fa-40b9-8f79-b3a841b87277 2021-04-14T11:16:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e34514d-f098-4bd2-b98c-d74d3e669ec1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e34514d-f098-4bd2-b98c-d74d3e669ec1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bc107b6 2021-04-14T11:16:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e34514d-f098-4bd2-b98c-d74d3e669ec1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e34514d-f098-4bd2-b98c-d74d3e669ec1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:04.346Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "42a21c1d-d929-4b62-8590-a9f5ba0bcc75" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscacsar" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Ns-csar.csar,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6758 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=8f18bbcd-fe57-4203-a404-2b8ad2ec8477 TargetServiceName=null EntryTimestamp=2021-04-14T11:15:57.588Z InvocationID=be960c9f-50b8-41c5-8c29-aaf2b3eea0a2 ErrorCode=500 LogTimestamp=2021-04-14T11:16:04.346036Z ResponseDesc=Created Exiting. 2021-04-14T11:16:04.346Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:16:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:16:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:16:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:16:04.373Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:16:04.374Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:16:04.374Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:16:04.437Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b1f697f6-abe9-49a4-8f76-8c43acda415e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:04.437167Z InvocationID=dc659610-177a-43a4-b0fc-403ccba56306 LogTimestamp=2021-04-14T11:16:04.437226Z Entering 2021-04-14T11:16:04.437Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b1f697f6-abe9-49a4-8f76-8c43acda415e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:04.437167Z InvocationID=dc659610-177a-43a4-b0fc-403ccba56306 LogTimestamp=2021-04-14T11:16:04.437226Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:16:06.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a5670b-b2d0-4b28-831b-430ee318e780 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:06.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a5670b-b2d0-4b28-831b-430ee318e780 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19d6bcaf 2021-04-14T11:16:06.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a5670b-b2d0-4b28-831b-430ee318e780 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:06.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21a5670b-b2d0-4b28-831b-430ee318e780 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:08.194Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:08.195Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:08.195Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:08.195Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:08.450Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Nsd 2021-04-14T11:16:09.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb39c7f1-7481-459c-ba93-e371b06d3f47 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:09.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb39c7f1-7481-459c-ba93-e371b06d3f47 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bd68862 2021-04-14T11:16:09.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb39c7f1-7481-459c-ba93-e371b06d3f47 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:09.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb39c7f1-7481-459c-ba93-e371b06d3f47 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:12.333Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.NSD" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a7276329-5258-4d30-8920-cd076a7c5e26 EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:16:12.334Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.NSD" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a7276329-5258-4d30-8920-cd076a7c5e26 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:16:12.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154c485b-a424-449f-98e5-4de2dadcbbaa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:12.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154c485b-a424-449f-98e5-4de2dadcbbaa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@738de0a 2021-04-14T11:16:12.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154c485b-a424-449f-98e5-4de2dadcbbaa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:12.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154c485b-a424-449f-98e5-4de2dadcbbaa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:13.641Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.NSD" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a7276329-5258-4d30-8920-cd076a7c5e26 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b ErrorCode=500 lock resource with id 3752eabf-6fa9-4234-80f9-3f45fbe40fb9 2021-04-14T11:16:15.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb7f08db-2907-46cd-871b-992b93b17f2f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:15.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb7f08db-2907-46cd-871b-992b93b17f2f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@145785ec 2021-04-14T11:16:15.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb7f08db-2907-46cd-871b-992b93b17f2f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:15.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb7f08db-2907-46cd-871b-992b93b17f2f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:15.817Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate" CURR_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nsd-template.yml,0,3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2fa665e3-c3b3-4cb4-9a17-7194552cc767 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b ErrorCode=500 Starting to create Csar for component NSD 2021-04-14T11:16:16.104Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate" CURR_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nsd-template.yml,0,3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2fa665e3-c3b3-4cb4-9a17-7194552cc767 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b ErrorCode=500 Ended create Csar for component NSD 2021-04-14T11:16:16.104Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate" CURR_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nsd-template.yml,0,3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2fa665e3-c3b3-4cb4-9a17-7194552cc767 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b ErrorCode=500 lock resource with id 3752eabf-6fa9-4234-80f9-3f45fbe40fb9 2021-04-14T11:16:17.956Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NSD" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a7276329-5258-4d30-8920-cd076a7c5e26" INVARIANT_UUID = "fb246059-fb56-408d-b341-daa78b3a7d8d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscacsar" CURR_ARTIFACT_UUID = "3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Nsd-csar.csar,0,3752eabf-6fa9-4234-80f9-3f45fbe40fb9.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13518 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7fda573d-07fc-4ded-b9ff-d03c5f302fd9 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:04.437Z InvocationID=ea383bbd-f38a-43ec-8813-3bc10e55c25b ErrorCode=500 LogTimestamp=2021-04-14T11:16:17.955892Z ResponseDesc=Created Exiting. 2021-04-14T11:16:17.957Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:16:17.978Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6ec4fbce-1d18-4be1-958f-92e34f5c40f0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:17.977859Z InvocationID=9d4bcded-8d36-408b-bbbd-25f568132097 LogTimestamp=2021-04-14T11:16:17.977918Z Entering 2021-04-14T11:16:17.978Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6ec4fbce-1d18-4be1-958f-92e34f5c40f0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:17.977859Z InvocationID=9d4bcded-8d36-408b-bbbd-25f568132097 LogTimestamp=2021-04-14T11:16:17.977918Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:16:18.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c5dfe35-aaa8-439e-b064-fc27700354c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:18.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c5dfe35-aaa8-439e-b064-fc27700354c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3848700d 2021-04-14T11:16:18.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c5dfe35-aaa8-439e-b064-fc27700354c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:18.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c5dfe35-aaa8-439e-b064-fc27700354c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:19.396Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:19.396Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:19.396Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:19.396Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:19.405Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Nsvirtuallink 2021-04-14T11:16:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d78eb16-7f04-43b0-9880-270355861e91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d78eb16-7f04-43b0-9880-270355861e91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27427afe 2021-04-14T11:16:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d78eb16-7f04-43b0-9880-270355861e91 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d78eb16-7f04-43b0-9880-270355861e91 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:20.723Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NsVirtualLink" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=43666977-2854-4276-b6b1-b2e991014131 EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:16:20.724Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NsVirtualLink" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=43666977-2854-4276-b6b1-b2e991014131 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:16:20.907Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NsVirtualLink" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=43666977-2854-4276-b6b1-b2e991014131 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 ErrorCode=500 lock resource with id ad70dfde-1164-4f01-be73-63fe0798a92d 2021-04-14T11:16:22.528Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate" CURR_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nsvirtuallink-template.yml,0,ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=27fa579f-d7a2-4ad4-aca3-c4fa009dc2f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 ErrorCode=500 Starting to create Csar for component NsVirtualLink 2021-04-14T11:16:22.730Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate" CURR_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nsvirtuallink-template.yml,0,ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=27fa579f-d7a2-4ad4-aca3-c4fa009dc2f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 ErrorCode=500 Ended create Csar for component NsVirtualLink 2021-04-14T11:16:22.730Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate" CURR_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nsvirtuallink-template.yml,0,ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=27fa579f-d7a2-4ad4-aca3-c4fa009dc2f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 ErrorCode=500 lock resource with id ad70dfde-1164-4f01-be73-63fe0798a92d 2021-04-14T11:16:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d740fd9-9d84-4721-99ae-33dd83387b36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d740fd9-9d84-4721-99ae-33dd83387b36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66cb2892 2021-04-14T11:16:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d740fd9-9d84-4721-99ae-33dd83387b36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d740fd9-9d84-4721-99ae-33dd83387b36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:24.843Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NsVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "43666977-2854-4276-b6b1-b2e991014131" INVARIANT_UUID = "042feae9-b370-473c-b7f4-268601ea963a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscacsar" CURR_ARTIFACT_UUID = "ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Nsvirtuallink-csar.csar,0,ad70dfde-1164-4f01-be73-63fe0798a92d.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6865 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=28861a60-8e23-41ed-a5e4-3bc447651b70 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:17.978Z InvocationID=968b8b1e-2f01-4fb5-b4f4-9844ea980c28 ErrorCode=500 LogTimestamp=2021-04-14T11:16:24.843181Z ResponseDesc=Created Exiting. 2021-04-14T11:16:24.843Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:16:24.935Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2c24e17e-3949-4b55-985c-224c53c5a4e4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:24.935709Z InvocationID=7c93f89f-2a88-4c10-a39b-a0bb9915895f LogTimestamp=2021-04-14T11:16:24.935756Z Entering 2021-04-14T11:16:24.936Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2c24e17e-3949-4b55-985c-224c53c5a4e4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:24.935709Z InvocationID=7c93f89f-2a88-4c10-a39b-a0bb9915895f LogTimestamp=2021-04-14T11:16:24.935756Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:16:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=372d4fe7-d482-42d6-810a-b415e31b2453 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=372d4fe7-d482-42d6-810a-b415e31b2453 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e1ba942 2021-04-14T11:16:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=372d4fe7-d482-42d6-810a-b415e31b2453 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=372d4fe7-d482-42d6-810a-b415e31b2453 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:28.533Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:28.533Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:28.533Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:28.533Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:28.748Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Vdu 2021-04-14T11:16:30.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb16e1a4-3503-4c99-940f-eab2d0e9f16a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:30.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb16e1a4-3503-4c99-940f-eab2d0e9f16a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35a87094 2021-04-14T11:16:30.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb16e1a4-3503-4c99-940f-eab2d0e9f16a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:30.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb16e1a4-3503-4c99-940f-eab2d0e9f16a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:32.834Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VDU" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5dbc382c-57c8-476e-a506-4e5c35a34805 EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:16:32.836Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VDU" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5dbc382c-57c8-476e-a506-4e5c35a34805 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:16:33.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423cae26-7920-4344-9c23-18137bda124d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:33.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423cae26-7920-4344-9c23-18137bda124d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1896955 2021-04-14T11:16:33.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423cae26-7920-4344-9c23-18137bda124d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:33.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423cae26-7920-4344-9c23-18137bda124d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:34.250Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VDU" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5dbc382c-57c8-476e-a506-4e5c35a34805 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c ErrorCode=500 lock resource with id 87a8f138-9120-4581-ad66-598e1b5085c6 2021-04-14T11:16:36.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0653b52f-4fcc-4eec-bf00-c80caa8bc967 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:36.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0653b52f-4fcc-4eec-bf00-c80caa8bc967 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3eb94e4e 2021-04-14T11:16:36.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0653b52f-4fcc-4eec-bf00-c80caa8bc967 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:36.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0653b52f-4fcc-4eec-bf00-c80caa8bc967 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:36.298Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate" CURR_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vdu-template.yml,0,87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ec55d81d-eaec-4d7d-867e-f269f5b1c02a TargetServiceName=null EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c ErrorCode=500 Starting to create Csar for component VDU 2021-04-14T11:16:36.490Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate" CURR_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vdu-template.yml,0,87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ec55d81d-eaec-4d7d-867e-f269f5b1c02a TargetServiceName=null EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c ErrorCode=500 Ended create Csar for component VDU 2021-04-14T11:16:36.490Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate" CURR_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vdu-template.yml,0,87a8f138-9120-4581-ad66-598e1b5085c6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ec55d81d-eaec-4d7d-867e-f269f5b1c02a TargetServiceName=null EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c ErrorCode=500 lock resource with id 87a8f138-9120-4581-ad66-598e1b5085c6 2021-04-14T11:16:38.397Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "5dbc382c-57c8-476e-a506-4e5c35a34805" INVARIANT_UUID = "ef196bc2-6422-4acd-86ea-234d8a9bc4dc" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscacsar" CURR_ARTIFACT_UUID = "87a8f138-9120-4581-ad66-598e1b5085c6.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Vdu-csar.csar,0,87a8f138-9120-4581-ad66-598e1b5085c6.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13460 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9818dfe9-1e0f-4153-b985-99b075e1948c TargetServiceName=null EntryTimestamp=2021-04-14T11:16:24.936Z InvocationID=fbe458a5-51cc-44d8-abdf-8536996fd65c ErrorCode=500 LogTimestamp=2021-04-14T11:16:38.396449Z ResponseDesc=Created Exiting. 2021-04-14T11:16:38.398Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:16:38.421Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=20f11c9d-4957-4392-a4ea-9057fc370ee0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:38.421229Z InvocationID=b8778544-258d-4426-9a8e-dbe66369bf9b LogTimestamp=2021-04-14T11:16:38.421271Z Entering 2021-04-14T11:16:38.421Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=20f11c9d-4957-4392-a4ea-9057fc370ee0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:38.421229Z InvocationID=b8778544-258d-4426-9a8e-dbe66369bf9b LogTimestamp=2021-04-14T11:16:38.421271Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:16:39.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cfa40a8-99db-4185-b0e8-7c2dd8973ec3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:39.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cfa40a8-99db-4185-b0e8-7c2dd8973ec3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d7ba162 2021-04-14T11:16:39.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cfa40a8-99db-4185-b0e8-7c2dd8973ec3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:39.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cfa40a8-99db-4185-b0e8-7c2dd8973ec3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:39.590Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:39.590Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:39.590Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:39.590Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:39.629Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VduCompute 2021-04-14T11:16:40.848Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.Compute" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3 EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:16:40.848Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:16:41.052Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 ErrorCode=500 lock resource with id 21adce5b-57a4-4536-b9d9-507dd806cf59 2021-04-14T11:16:41.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e53685-cdab-4580-8807-fecaf02683aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e53685-cdab-4580-8807-fecaf02683aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b214889 2021-04-14T11:16:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e53685-cdab-4580-8807-fecaf02683aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e53685-cdab-4580-8807-fecaf02683aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:42.741Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" CURR_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCompute-template.yml,0,21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=88d62477-8fe4-4299-aff5-2bb4152295c8 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 ErrorCode=500 Starting to create Csar for component VDU Compute 2021-04-14T11:16:43.010Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" CURR_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCompute-template.yml,0,21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=88d62477-8fe4-4299-aff5-2bb4152295c8 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 ErrorCode=500 Ended create Csar for component VDU Compute 2021-04-14T11:16:43.011Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" CURR_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCompute-template.yml,0,21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=88d62477-8fe4-4299-aff5-2bb4152295c8 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 ErrorCode=500 lock resource with id 21adce5b-57a4-4536-b9d9-507dd806cf59 2021-04-14T11:16:44.843Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c21cc3c6-966d-4750-8f21-ce1bcb3eb7e3" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscacsar" CURR_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduCompute-csar.csar,0,21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=6421 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=41b4ef0d-dd49-4960-bd4d-1b55215217c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:38.422Z InvocationID=029d441b-9e2c-48bc-94b4-59a477066f32 ErrorCode=500 LogTimestamp=2021-04-14T11:16:44.843236Z ResponseDesc=Created Exiting. 2021-04-14T11:16:44.844Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:16:44.860Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5a1a5b2f-1f53-4a60-88d5-463d9fc2f1f8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:44.860453Z InvocationID=f86c3954-51be-47d9-a267-db07bccf87ca LogTimestamp=2021-04-14T11:16:44.860498Z Entering 2021-04-14T11:16:44.860Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5a1a5b2f-1f53-4a60-88d5-463d9fc2f1f8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:16:44.860453Z InvocationID=f86c3954-51be-47d9-a267-db07bccf87ca LogTimestamp=2021-04-14T11:16:44.860498Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa89203-854b-4757-9f44-445e0750f4de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa89203-854b-4757-9f44-445e0750f4de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11285179 2021-04-14T11:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa89203-854b-4757-9f44-445e0750f4de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7aa89203-854b-4757-9f44-445e0750f4de PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:48.433Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:48.433Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:48.433Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:48.433Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:16:48.434Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Cp 2021-04-14T11:16:48.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450b4ff9-f60e-419f-b644-c09cfbaf68d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:48.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450b4ff9-f60e-419f-b644-c09cfbaf68d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6517a62c 2021-04-14T11:16:48.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450b4ff9-f60e-419f-b644-c09cfbaf68d8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:48.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450b4ff9-f60e-419f-b644-c09cfbaf68d8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f73560c-fb2b-4226-8df6-cc9ba42f7516 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f73560c-fb2b-4226-8df6-cc9ba42f7516 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15177b5d 2021-04-14T11:16:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f73560c-fb2b-4226-8df6-cc9ba42f7516 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:51.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f73560c-fb2b-4226-8df6-cc9ba42f7516 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:54.010Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Cp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=220f17c5-95a1-47cf-8b08-f0f03c823e2d EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:16:54.010Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Cp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=220f17c5-95a1-47cf-8b08-f0f03c823e2d TargetServiceName=null EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:16:54.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a254b29a-3903-4ce3-9530-971d417200c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:54.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a254b29a-3903-4ce3-9530-971d417200c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44a30c76 2021-04-14T11:16:54.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a254b29a-3903-4ce3-9530-971d417200c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:54.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a254b29a-3903-4ce3-9530-971d417200c0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:56.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3872d707-c06f-482d-9b76-e210a37e4daf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:56.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3872d707-c06f-482d-9b76-e210a37e4daf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17533e02 2021-04-14T11:16:56.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3872d707-c06f-482d-9b76-e210a37e4daf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:56.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3872d707-c06f-482d-9b76-e210a37e4daf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:16:57.089Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Cp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=220f17c5-95a1-47cf-8b08-f0f03c823e2d TargetServiceName=null EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f ErrorCode=500 lock resource with id 4f076bd0-9c5a-4a28-a433-ba8bdf4c956c 2021-04-14T11:16:59.041Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate" CURR_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Cp-template.yml,0,4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1f8f5d99-ec05-41d7-bcb6-19c4929b3e55 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f ErrorCode=500 Starting to create Csar for component Cp 2021-04-14T11:16:59.286Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate" CURR_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Cp-template.yml,0,4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1f8f5d99-ec05-41d7-bcb6-19c4929b3e55 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f ErrorCode=500 Ended create Csar for component Cp 2021-04-14T11:16:59.286Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate" CURR_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Cp-template.yml,0,4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1f8f5d99-ec05-41d7-bcb6-19c4929b3e55 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f ErrorCode=500 lock resource with id 4f076bd0-9c5a-4a28-a433-ba8bdf4c956c 2021-04-14T11:16:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5e8cf6-655e-439d-a88f-8fc3bc3659a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:16:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5e8cf6-655e-439d-a88f-8fc3bc3659a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f2ddc02 2021-04-14T11:16:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5e8cf6-655e-439d-a88f-8fc3bc3659a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:16:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d5e8cf6-655e-439d-a88f-8fc3bc3659a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:00.880Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Cp" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "220f17c5-95a1-47cf-8b08-f0f03c823e2d" INVARIANT_UUID = "650beb69-3eb4-429f-83a4-1982e7d2605c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscacsar" CURR_ARTIFACT_UUID = "4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Cp-csar.csar,0,4f076bd0-9c5a-4a28-a433-ba8bdf4c956c.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=16018 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cc31b6a-0fde-4882-843a-9a85ec8073a8 TargetServiceName=null EntryTimestamp=2021-04-14T11:16:44.861Z InvocationID=bd7fdd40-1179-4882-b4b5-dca3daf72c2f ErrorCode=500 LogTimestamp=2021-04-14T11:17:00.879908Z ResponseDesc=Created Exiting. 2021-04-14T11:17:00.880Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:17:00.893Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8d9ca9aa-2a69-43e1-9994-ba2b6add905f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:00.892709Z InvocationID=7f6068de-02f1-4dd8-85dc-25c0ac662386 LogTimestamp=2021-04-14T11:17:00.892796Z Entering 2021-04-14T11:17:00.893Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8d9ca9aa-2a69-43e1-9994-ba2b6add905f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:00.892709Z InvocationID=7f6068de-02f1-4dd8-85dc-25c0ac662386 LogTimestamp=2021-04-14T11:17:00.892796Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:17:01.111Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:01.111Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:01.111Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:01.111Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:01.119Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VduVirtualstorage 2021-04-14T11:17:02.426Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=acbd5fe0-85b4-4ae7-876a-987df0e0c0df EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:17:02.427Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=acbd5fe0-85b4-4ae7-876a-987df0e0c0df TargetServiceName=null EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:17:02.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e127f70b-cafc-4d7f-9849-caf69b14671f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:02.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e127f70b-cafc-4d7f-9849-caf69b14671f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61ce8b29 2021-04-14T11:17:02.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e127f70b-cafc-4d7f-9849-caf69b14671f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:02.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e127f70b-cafc-4d7f-9849-caf69b14671f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:03.016Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=acbd5fe0-85b4-4ae7-876a-987df0e0c0df TargetServiceName=null EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 ErrorCode=500 lock resource with id 09d69617-d0f1-4236-8e32-bbfe23874560 2021-04-14T11:17:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:17:04.350Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:17:04.350Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:17:04.393Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:17:04.394Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:17:04.394Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:17:05.129Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate" CURR_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualstorage-template.yml,0,09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a5f4ab07-2dfd-4e91-9bc3-a1c56d6d3527 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 ErrorCode=500 Starting to create Csar for component VDU VirtualStorage 2021-04-14T11:17:05.338Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate" CURR_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualstorage-template.yml,0,09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a5f4ab07-2dfd-4e91-9bc3-a1c56d6d3527 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 ErrorCode=500 Ended create Csar for component VDU VirtualStorage 2021-04-14T11:17:05.338Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate" CURR_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualstorage-template.yml,0,09d69617-d0f1-4236-8e32-bbfe23874560.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a5f4ab07-2dfd-4e91-9bc3-a1c56d6d3527 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 ErrorCode=500 lock resource with id 09d69617-d0f1-4236-8e32-bbfe23874560 2021-04-14T11:17:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115b33e9-f96b-4244-8b12-59118ed18ad7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115b33e9-f96b-4244-8b12-59118ed18ad7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d52fbda 2021-04-14T11:17:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115b33e9-f96b-4244-8b12-59118ed18ad7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115b33e9-f96b-4244-8b12-59118ed18ad7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:09.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf29080-eb41-4847-842a-e19dc2da3489 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:09.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf29080-eb41-4847-842a-e19dc2da3489 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@337f715c 2021-04-14T11:17:09.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf29080-eb41-4847-842a-e19dc2da3489 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:09.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaf29080-eb41-4847-842a-e19dc2da3489 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:09.243Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "acbd5fe0-85b4-4ae7-876a-987df0e0c0df" INVARIANT_UUID = "8ec53fa8-bea9-4c58-8427-d61638fb620a" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscacsar" CURR_ARTIFACT_UUID = "09d69617-d0f1-4236-8e32-bbfe23874560.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduVirtualstorage-csar.csar,0,09d69617-d0f1-4236-8e32-bbfe23874560.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=8349 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ca263b5f-298d-4097-a6ad-8a7aefefcbb6 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:00.893Z InvocationID=a86566ed-350b-47c8-88b1-a4b73a482df8 ErrorCode=500 LogTimestamp=2021-04-14T11:17:09.242559Z ResponseDesc=Created Exiting. 2021-04-14T11:17:09.243Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:17:09.339Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c51885e3-70aa-4a76-9cac-3e7c9c58809f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:09.338896Z InvocationID=9cbf95d1-fa60-4666-8852-e5f50c064355 LogTimestamp=2021-04-14T11:17:09.338954Z Entering 2021-04-14T11:17:09.339Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c51885e3-70aa-4a76-9cac-3e7c9c58809f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:09.338896Z InvocationID=9cbf95d1-fa60-4666-8852-e5f50c064355 LogTimestamp=2021-04-14T11:17:09.338954Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:17:12.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bee627f-f7b0-499b-8fd1-e7acf685de54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:12.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bee627f-f7b0-499b-8fd1-e7acf685de54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@129366fd 2021-04-14T11:17:12.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bee627f-f7b0-499b-8fd1-e7acf685de54 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:12.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bee627f-f7b0-499b-8fd1-e7acf685de54 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:12.418Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:12.418Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:12.419Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:12.419Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:12.439Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VduVirtualblockstorage 2021-04-14T11:17:15.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:15.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7112045 2021-04-14T11:17:15.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:15.156Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:18.164Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:17:18.165Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:17:18.166Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:17:18.166Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5d203a0d-5202-43bd-abc8-796e709cdc78 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:17:18.815Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:17:18.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:17:20.044Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=17f0591b-9a04-4a7c-83ee-8b2413233295 EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:17:20.046Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=17f0591b-9a04-4a7c-83ee-8b2413233295 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:17:20.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e886889-5356-4ab2-a199-a3c4f9a0c5bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:20.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e886889-5356-4ab2-a199-a3c4f9a0c5bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d379756 2021-04-14T11:17:20.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e886889-5356-4ab2-a199-a3c4f9a0c5bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:20.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e886889-5356-4ab2-a199-a3c4f9a0c5bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:20.837Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:17:21.447Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=17f0591b-9a04-4a7c-83ee-8b2413233295 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 ErrorCode=500 lock resource with id 893b16db-8e31-49c5-ac17-e9e74bf0903e 2021-04-14T11:17:22.465Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3e886889-5356-4ab2-a199-a3c4f9a0c5bc ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:17:22.465Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3e886889-5356-4ab2-a199-a3c4f9a0c5bc ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:17:23.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d50069b7-b6dc-439e-9b1a-6b972a9cc869 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:23.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d50069b7-b6dc-439e-9b1a-6b972a9cc869 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c27d0ff 2021-04-14T11:17:23.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d50069b7-b6dc-439e-9b1a-6b972a9cc869 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:23.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d50069b7-b6dc-439e-9b1a-6b972a9cc869 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:23.527Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualblockstorage-template.yml,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6690c059-175e-4f57-8d30-6a068a65ab8e TargetServiceName=null EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 ErrorCode=500 Starting to create Csar for component VDU VirtualBlockStorage 2021-04-14T11:17:23.766Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualblockstorage-template.yml,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6690c059-175e-4f57-8d30-6a068a65ab8e TargetServiceName=null EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 ErrorCode=500 Ended create Csar for component VDU VirtualBlockStorage 2021-04-14T11:17:23.766Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualblockstorage-template.yml,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6690c059-175e-4f57-8d30-6a068a65ab8e TargetServiceName=null EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 ErrorCode=500 lock resource with id 893b16db-8e31-49c5-ac17-e9e74bf0903e 2021-04-14T11:17:24.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0091e049-83d5-45e2-bd26-277f23087350 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:24.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0091e049-83d5-45e2-bd26-277f23087350 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@623ac636 2021-04-14T11:17:24.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0091e049-83d5-45e2-bd26-277f23087350 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:24.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0091e049-83d5-45e2-bd26-277f23087350 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d567f8fb-0a9e-40e8-9fc7-6f58fc48d88b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d567f8fb-0a9e-40e8-9fc7-6f58fc48d88b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73266000 2021-04-14T11:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d567f8fb-0a9e-40e8-9fc7-6f58fc48d88b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d567f8fb-0a9e-40e8-9fc7-6f58fc48d88b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:27.401Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "17f0591b-9a04-4a7c-83ee-8b2413233295" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscacsar" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduVirtualblockstorage-csar.csar,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=18061 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=67f7b40c-3000-4946-bbf8-2ae135ce28fb TargetServiceName=null EntryTimestamp=2021-04-14T11:17:09.339Z InvocationID=4c3d04bd-aef1-4b6a-b5a3-1c45f71ee0f3 ErrorCode=500 LogTimestamp=2021-04-14T11:17:27.400835Z ResponseDesc=Created Exiting. 2021-04-14T11:17:27.402Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:17:27.538Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ff63bda9-9d28-4089-955a-3b7951ab093c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:27.538025Z InvocationID=ca99fb46-e607-46bd-ae55-5efbcab32474 LogTimestamp=2021-04-14T11:17:27.538098Z Entering 2021-04-14T11:17:27.538Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ff63bda9-9d28-4089-955a-3b7951ab093c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:27.538025Z InvocationID=ca99fb46-e607-46bd-ae55-5efbcab32474 LogTimestamp=2021-04-14T11:17:27.538098Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:17:30.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=404fc2b0-95f8-49c1-a252-4762e181d94c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:30.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=404fc2b0-95f8-49c1-a252-4762e181d94c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@412f5b47 2021-04-14T11:17:30.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=404fc2b0-95f8-49c1-a252-4762e181d94c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:30.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=404fc2b0-95f8-49c1-a252-4762e181d94c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:31.439Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:31.439Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:31.439Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:31.439Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:31.642Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VduVirtualfilestorage 2021-04-14T11:17:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3120359-cee6-46f7-bb85-094c9f93273c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3120359-cee6-46f7-bb85-094c9f93273c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13ddcbb5 2021-04-14T11:17:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3120359-cee6-46f7-bb85-094c9f93273c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3120359-cee6-46f7-bb85-094c9f93273c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:35.729Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualFileStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9d5f79c1-be0e-4733-a6cd-edc999dbc08b EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:17:35.730Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualFileStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9d5f79c1-be0e-4733-a6cd-edc999dbc08b TargetServiceName=null EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:17:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1288ce12-9f22-4fb9-939a-8cefffb252d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1288ce12-9f22-4fb9-939a-8cefffb252d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2762a48e 2021-04-14T11:17:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1288ce12-9f22-4fb9-939a-8cefffb252d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1288ce12-9f22-4fb9-939a-8cefffb252d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:37.435Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualFileStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9d5f79c1-be0e-4733-a6cd-edc999dbc08b TargetServiceName=null EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd ErrorCode=500 lock resource with id 1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073 2021-04-14T11:17:39.203Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7527fea5-08bf-4ae3-834b-cd89060b01c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:39.203Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7527fea5-08bf-4ae3-834b-cd89060b01c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6784e602 2021-04-14T11:17:39.203Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7527fea5-08bf-4ae3-834b-cd89060b01c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:39.203Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7527fea5-08bf-4ae3-834b-cd89060b01c5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:39.782Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" CURR_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualfilestorage-template.yml,0,1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0bd76be3-4092-4a75-bbc4-a39ca084e580 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd ErrorCode=500 Starting to create Csar for component VDU VirtualFileStorage 2021-04-14T11:17:40.009Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" CURR_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualfilestorage-template.yml,0,1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0bd76be3-4092-4a75-bbc4-a39ca084e580 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd ErrorCode=500 Ended create Csar for component VDU VirtualFileStorage 2021-04-14T11:17:40.009Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" CURR_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualfilestorage-template.yml,0,1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0bd76be3-4092-4a75-bbc4-a39ca084e580 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd ErrorCode=500 lock resource with id 1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073 2021-04-14T11:17:41.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4e5ecc5-02c5-48d9-a0bc-977ee9750191 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:41.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4e5ecc5-02c5-48d9-a0bc-977ee9750191 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cca6cd6 2021-04-14T11:17:41.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4e5ecc5-02c5-48d9-a0bc-977ee9750191 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:41.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4e5ecc5-02c5-48d9-a0bc-977ee9750191 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:41.789Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "9d5f79c1-be0e-4733-a6cd-edc999dbc08b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscacsar" CURR_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduVirtualfilestorage-csar.csar,0,1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14251 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4ce9710e-7c0f-4de3-a9c3-fb82e959cec4 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:27.538Z InvocationID=95d7415c-7c7d-41dd-8695-3496fd4e23fd ErrorCode=500 LogTimestamp=2021-04-14T11:17:41.789168Z ResponseDesc=Created Exiting. 2021-04-14T11:17:41.790Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:17:41.837Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=373cb57f-3c9e-4670-8de3-9eede68c7b4f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:41.837376Z InvocationID=ea05de65-a12e-4493-823f-8460494b49e5 LogTimestamp=2021-04-14T11:17:41.837435Z Entering 2021-04-14T11:17:41.837Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=373cb57f-3c9e-4670-8de3-9eede68c7b4f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:41.837376Z InvocationID=ea05de65-a12e-4493-823f-8460494b49e5 LogTimestamp=2021-04-14T11:17:41.837435Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:17:42.113Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:42.114Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:42.114Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:42.114Z [qtp580718781-16] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:42.124Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VduVirtualobjectstorage 2021-04-14T11:17:43.824Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualObjectStorage" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3da8d35e-ccc9-4848-bc24-510f3e3c0c99 EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:17:43.824Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualObjectStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3da8d35e-ccc9-4848-bc24-510f3e3c0c99 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:17:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c45a56-5d7f-462e-a96c-d6e66ac60532 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c45a56-5d7f-462e-a96c-d6e66ac60532 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21378499 2021-04-14T11:17:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c45a56-5d7f-462e-a96c-d6e66ac60532 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c45a56-5d7f-462e-a96c-d6e66ac60532 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:45.393Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualObjectStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3da8d35e-ccc9-4848-bc24-510f3e3c0c99 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 ErrorCode=500 lock resource with id 2a51e13e-f8ea-4146-9057-bd6108e0e414 2021-04-14T11:17:48.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee27ccae-ed35-425c-b135-fba847e46e61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:48.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee27ccae-ed35-425c-b135-fba847e46e61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@134312e5 2021-04-14T11:17:48.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee27ccae-ed35-425c-b135-fba847e46e61 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:48.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee27ccae-ed35-425c-b135-fba847e46e61 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:48.691Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate" CURR_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualobjectstorage-template.yml,0,2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e94306f0-ae86-4ee1-8c52-bf53c5a9b21f TargetServiceName=null EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 ErrorCode=500 Starting to create Csar for component VDU VirtualObjectStorage 2021-04-14T11:17:49.040Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate" CURR_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualobjectstorage-template.yml,0,2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e94306f0-ae86-4ee1-8c52-bf53c5a9b21f TargetServiceName=null EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 ErrorCode=500 Ended create Csar for component VDU VirtualObjectStorage 2021-04-14T11:17:49.040Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate" CURR_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualobjectstorage-template.yml,0,2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e94306f0-ae86-4ee1-8c52-bf53c5a9b21f TargetServiceName=null EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 ErrorCode=500 lock resource with id 2a51e13e-f8ea-4146-9057-bd6108e0e414 2021-04-14T11:17:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44344c7c-c0ac-4465-918d-d017380f99b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44344c7c-c0ac-4465-918d-d017380f99b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53375279 2021-04-14T11:17:51.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44344c7c-c0ac-4465-918d-d017380f99b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:51.316Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44344c7c-c0ac-4465-918d-d017380f99b1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:51.741Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualObjectStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "3da8d35e-ccc9-4848-bc24-510f3e3c0c99" INVARIANT_UUID = "bb113f3b-ecc9-4465-8256-e09f39296173" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscacsar" CURR_ARTIFACT_UUID = "2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduVirtualobjectstorage-csar.csar,0,2a51e13e-f8ea-4146-9057-bd6108e0e414.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9903 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7a28f577-b7b1-4364-9016-b0f71ae9cacf TargetServiceName=null EntryTimestamp=2021-04-14T11:17:41.838Z InvocationID=88384b3e-831f-4b45-910e-bf4f4a699735 ErrorCode=500 LogTimestamp=2021-04-14T11:17:51.741644Z ResponseDesc=Created Exiting. 2021-04-14T11:17:51.742Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:17:51.831Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cbabc0a7-4b94-494e-a49b-da758214e74e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:51.831014Z InvocationID=229bcc3a-f1c4-4159-a4de-714a4636cbd6 LogTimestamp=2021-04-14T11:17:51.831050Z Entering 2021-04-14T11:17:51.831Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cbabc0a7-4b94-494e-a49b-da758214e74e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:51.831014Z InvocationID=229bcc3a-f1c4-4159-a4de-714a4636cbd6 LogTimestamp=2021-04-14T11:17:51.831050Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:17:52.940Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource vduVirtualStorage.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:17:51.831Z InvocationID=482ed6e9-df2d-4ea8-a9a5-3e184b02fdcc ErrorCode=500 Unexpected error during operation 2021-04-14T11:17:52.943Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this VDU VirtualStorage was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:17:51.831Z InvocationID=482ed6e9-df2d-4ea8-a9a5-3e184b02fdcc ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:17:52.945Z [qtp580718781-17] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this VDU VirtualStorage was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:17:51.831Z InvocationID=482ed6e9-df2d-4ea8-a9a5-3e184b02fdcc ErrorCode=900 #uploadMultipart('multipart', /tmp/rep1899928737373218560tmp, 'form-data; filename="vduVirtualStorage.zip"; name="resourceZip"', '{"payloadName": "vduVirtualStorage.yml", "contactId": "jh0003", "name": "VDU VirtualStorage", "description": "VDU VirtualStorage", "resourceIconPath": "objectStorage", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Infrastructure"}]}], "tags": ["VDU VirtualStorage"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByActionStatusComponentException out of org.openecomp.sdc.be.components.impl.ResourceImportManager#importCertifiedResource[211] in 1s 2021-04-14T11:17:52.946Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this VDU VirtualStorage was already promoted." TOSCA_NODE_TYPE = "" ResponseCode=409 RequestID=null ElapsedTime=1115 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null ErrorDesc=Conflict EntryTimestamp=2021-04-14T11:17:51.831Z InvocationID=482ed6e9-df2d-4ea8-a9a5-3e184b02fdcc ErrorCode=409 LogTimestamp=2021-04-14T11:17:52.946221Z ResponseDesc=Conflict Exiting. 2021-04-14T11:17:52.946Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="409" 2021-04-14T11:17:53.042Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=56be6379-8f65-4071-8763-567777885c22 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:53.042636Z InvocationID=7c4301f5-0452-405a-bc01-6e4c16a686f7 LogTimestamp=2021-04-14T11:17:53.042691Z Entering 2021-04-14T11:17:53.043Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=56be6379-8f65-4071-8763-567777885c22 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:17:53.042636Z InvocationID=7c4301f5-0452-405a-bc01-6e4c16a686f7 LogTimestamp=2021-04-14T11:17:53.042691Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:17:54.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7adc41-c290-4ce7-822d-2e58c6190106 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:54.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7adc41-c290-4ce7-822d-2e58c6190106 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c943815 2021-04-14T11:17:54.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7adc41-c290-4ce7-822d-2e58c6190106 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:54.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db7adc41-c290-4ce7-822d-2e58c6190106 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:55.214Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:55.214Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:55.214Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:55.214Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:17:55.293Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Vnfvirtuallink 2021-04-14T11:17:56.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aea270c-e7e7-4533-95bb-26c537a7fdb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:56.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aea270c-e7e7-4533-95bb-26c537a7fdb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@411a7c52 2021-04-14T11:17:56.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aea270c-e7e7-4533-95bb-26c537a7fdb6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:56.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aea270c-e7e7-4533-95bb-26c537a7fdb6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:57.185Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfVirtualLink" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=29bec0ad-68dc-4314-a85e-9c210770b390 EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:17:57.186Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfVirtualLink" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=29bec0ad-68dc-4314-a85e-9c210770b390 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:17:57.791Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfVirtualLink" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=29bec0ad-68dc-4314-a85e-9c210770b390 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 ErrorCode=500 lock resource with id e941f4f9-2292-4816-8e11-a668e3aa2deb 2021-04-14T11:17:59.534Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate" CURR_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnfvirtuallink-template.yml,0,e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e3e7deb0-8f2d-45a3-b1d5-7e7127e355e8 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 ErrorCode=500 Starting to create Csar for component VnfVirtualLink 2021-04-14T11:17:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6e3df6f-b5a6-49d3-bf05-e6f6d00d17cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:17:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6e3df6f-b5a6-49d3-bf05-e6f6d00d17cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ac59aae 2021-04-14T11:17:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6e3df6f-b5a6-49d3-bf05-e6f6d00d17cf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:17:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6e3df6f-b5a6-49d3-bf05-e6f6d00d17cf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:17:59.750Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate" CURR_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnfvirtuallink-template.yml,0,e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e3e7deb0-8f2d-45a3-b1d5-7e7127e355e8 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 ErrorCode=500 Ended create Csar for component VnfVirtualLink 2021-04-14T11:17:59.750Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate" CURR_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnfvirtuallink-template.yml,0,e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e3e7deb0-8f2d-45a3-b1d5-7e7127e355e8 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 ErrorCode=500 lock resource with id e941f4f9-2292-4816-8e11-a668e3aa2deb 2021-04-14T11:18:01.341Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VnfVirtualLink" RESOURCE_TYPE = "VL" SERVICE_INSTANCE_ID = "29bec0ad-68dc-4314-a85e-9c210770b390" INVARIANT_UUID = "f35bb5ee-9a20-459d-9932-889476186525" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscacsar" CURR_ARTIFACT_UUID = "e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Vnfvirtuallink-csar.csar,0,e941f4f9-2292-4816-8e11-a668e3aa2deb.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=8298 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4d28df9c-b70b-4c10-ad47-42423770b1f7 TargetServiceName=null EntryTimestamp=2021-04-14T11:17:53.043Z InvocationID=7c065b7c-ebab-426d-acb8-a3912ec0c4f1 ErrorCode=500 LogTimestamp=2021-04-14T11:18:01.341030Z ResponseDesc=Created Exiting. 2021-04-14T11:18:01.341Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:18:01.356Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4fb21d15-0b1f-4c9d-96cb-47bb65c99241 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:01.355887Z InvocationID=1de9b3e3-7ffe-4f46-beb8-2f6b49d16a08 LogTimestamp=2021-04-14T11:18:01.355932Z Entering 2021-04-14T11:18:01.356Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4fb21d15-0b1f-4c9d-96cb-47bb65c99241 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:01.355887Z InvocationID=1de9b3e3-7ffe-4f46-beb8-2f6b49d16a08 LogTimestamp=2021-04-14T11:18:01.355932Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:18:01.611Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:01.611Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:01.611Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:01.611Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:01.620Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VnfExternalCp 2021-04-14T11:18:02.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e83e36-8455-471c-944f-05d64fce385c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:02.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e83e36-8455-471c-944f-05d64fce385c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2308ad15 2021-04-14T11:18:02.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e83e36-8455-471c-944f-05d64fce385c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:02.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1e83e36-8455-471c-944f-05d64fce385c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:03.312Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfExtCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=723e8a84-350e-4b12-863e-4323d9edc315 EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:18:03.313Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfExtCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=723e8a84-350e-4b12-863e-4323d9edc315 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:18:04.120Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfExtCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=723e8a84-350e-4b12-863e-4323d9edc315 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 ErrorCode=500 lock resource with id cb33efd8-ad02-4add-87f8-f92e9e664635 2021-04-14T11:18:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:18:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:18:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:18:04.367Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:18:04.367Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:18:04.368Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:18:06.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21d2083b-610c-433e-a8da-74c59ed8b198 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:06.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21d2083b-610c-433e-a8da-74c59ed8b198 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e216df1 2021-04-14T11:18:06.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21d2083b-610c-433e-a8da-74c59ed8b198 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:06.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21d2083b-610c-433e-a8da-74c59ed8b198 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:07.911Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VnfExternalCp-template.yml,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=85b39a08-863c-4d6b-867f-578e1258697c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 ErrorCode=500 Starting to create Csar for component VNF External CP 2021-04-14T11:18:08.103Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VnfExternalCp-template.yml,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=85b39a08-863c-4d6b-867f-578e1258697c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 ErrorCode=500 Ended create Csar for component VNF External CP 2021-04-14T11:18:08.104Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VnfExternalCp-template.yml,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=85b39a08-863c-4d6b-867f-578e1258697c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 ErrorCode=500 lock resource with id cb33efd8-ad02-4add-87f8-f92e9e664635 2021-04-14T11:18:09.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7abae806-7e89-489c-a64d-dfca04f01582 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:09.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7abae806-7e89-489c-a64d-dfca04f01582 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c4b728b 2021-04-14T11:18:09.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7abae806-7e89-489c-a64d-dfca04f01582 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:09.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7abae806-7e89-489c-a64d-dfca04f01582 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:10.784Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d30f9615-01bb-4eab-90fa-1f43c39f5b05 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:10.784042Z InvocationID=b90a3567-c218-4cf1-a73f-f2d2648b44c0 LogTimestamp=2021-04-14T11:18:10.784119Z Entering 2021-04-14T11:18:10.784Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d30f9615-01bb-4eab-90fa-1f43c39f5b05 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:10.784042Z InvocationID=b90a3567-c218-4cf1-a73f-f2d2648b44c0 LogTimestamp=2021-04-14T11:18:10.784119Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:18:10.788Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=4 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:18:10.784Z InvocationID=3317b54e-46c7-44ab-925c-34cce511d7a1 LogTimestamp=2021-04-14T11:18:10.788323Z ResponseDesc=OK Exiting. 2021-04-14T11:18:10.788Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:18:11.141Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "723e8a84-350e-4b12-863e-4323d9edc315" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscacsar" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VnfExternalCp-csar.csar,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=9785 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=2b688769-f098-4070-b42d-cefc6c385622 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:01.356Z InvocationID=033cda38-7689-49ad-be72-c7289b1800c9 ErrorCode=500 LogTimestamp=2021-04-14T11:18:11.141499Z ResponseDesc=Created Exiting. 2021-04-14T11:18:11.142Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:18:11.232Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3afeeae9-a865-4941-9727-d291e6a075e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:11.232094Z InvocationID=1aac51ac-201b-499b-903d-93978c4782f6 LogTimestamp=2021-04-14T11:18:11.232127Z Entering 2021-04-14T11:18:11.232Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3afeeae9-a865-4941-9727-d291e6a075e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:11.232094Z InvocationID=1aac51ac-201b-499b-903d-93978c4782f6 LogTimestamp=2021-04-14T11:18:11.232127Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:18:12.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c6666df-3d5c-43ef-96ac-bca9f4e85263 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:12.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c6666df-3d5c-43ef-96ac-bca9f4e85263 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a3d9146 2021-04-14T11:18:12.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c6666df-3d5c-43ef-96ac-bca9f4e85263 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:12.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c6666df-3d5c-43ef-96ac-bca9f4e85263 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:13.039Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:13.039Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:13.040Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:13.040Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:18:13.336Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VduCp 2021-04-14T11:18:15.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bd2a817-680c-45b9-9177-08f4ca425618 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:15.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bd2a817-680c-45b9-9177-08f4ca425618 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c3be111 2021-04-14T11:18:15.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bd2a817-680c-45b9-9177-08f4ca425618 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:15.147Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bd2a817-680c-45b9-9177-08f4ca425618 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:18.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c0af76-d2ac-4bae-bebb-4f194a7cab13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:18.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c0af76-d2ac-4bae-bebb-4f194a7cab13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19205382 2021-04-14T11:18:18.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c0af76-d2ac-4bae-bebb-4f194a7cab13 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:18.971Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80c0af76-d2ac-4bae-bebb-4f194a7cab13 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:21.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3b321b-6126-4fa9-803d-fd37a87b1684 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:21.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3b321b-6126-4fa9-803d-fd37a87b1684 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e68b507 2021-04-14T11:18:21.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3b321b-6126-4fa9-803d-fd37a87b1684 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:21.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca3b321b-6126-4fa9-803d-fd37a87b1684 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:24.629Z [qtp580718781-11] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c0ac6761-c4ca-4e9e-a693-628ddb022405 EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:18:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:27.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:18:28.615Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c2e6feb9-f2de-40a2-ac58-32027bf3799e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:28.614932Z InvocationID=c72ae073-7f88-4842-96c7-f2f13a3db62d LogTimestamp=2021-04-14T11:18:28.615056Z Entering 2021-04-14T11:18:28.615Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c2e6feb9-f2de-40a2-ac58-32027bf3799e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:18:28.614932Z InvocationID=c72ae073-7f88-4842-96c7-f2f13a3db62d LogTimestamp=2021-04-14T11:18:28.615056Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:18:28.616Z [qtp580718781-14] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:18:28.616Z InvocationID=8091aefc-7ef2-4e9b-b560-3330728e5539 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:18:28.657Z [qtp580718781-14] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=dcae-sch ElapsedTime=3 EndTimestamp=2021-04-14T11:18:28.619Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.5.14 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:18:28.616Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=8091aefc-7ef2-4e9b-b560-3330728e5539 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@175250a4 2021-04-14T11:18:28.657Z [qtp580718781-14] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=dcae-sch ElapsedTime=3 EndTimestamp=2021-04-14T11:18:28.619Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.5.14 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:18:28.616Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=8091aefc-7ef2-4e9b-b560-3330728e5539 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@175250a4 2021-04-14T11:18:28.660Z [qtp580718781-14] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:18:28.659843Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:18:28.660Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:18:28.659843Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:18:28.660Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:18:28.835Z [qtp580718781-11] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c0ac6761-c4ca-4e9e-a693-628ddb022405 EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:18:29.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652526bc-b4be-4cf7-aeac-f39cedb388b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:29.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652526bc-b4be-4cf7-aeac-f39cedb388b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4899a22d 2021-04-14T11:18:29.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652526bc-b4be-4cf7-aeac-f39cedb388b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:29.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652526bc-b4be-4cf7-aeac-f39cedb388b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:29.212Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c0ac6761-c4ca-4e9e-a693-628ddb022405 EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:18:29.213Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c0ac6761-c4ca-4e9e-a693-628ddb022405 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:18:29.930Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:18:29.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c8e60eb-16f5-426f-b224-f4b78d755b38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:29.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c8e60eb-16f5-426f-b224-f4b78d755b38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bb9f146 2021-04-14T11:18:29.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c8e60eb-16f5-426f-b224-f4b78d755b38 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:29.961Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c8e60eb-16f5-426f-b224-f4b78d755b38 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:30.236Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4c8e60eb-16f5-426f-b224-f4b78d755b38 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:18:30.237Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=4c8e60eb-16f5-426f-b224-f4b78d755b38 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:18:31.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a7fc65-902f-4303-9699-a5dc23942bea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:31.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a7fc65-902f-4303-9699-a5dc23942bea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@409e05f0 2021-04-14T11:18:31.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a7fc65-902f-4303-9699-a5dc23942bea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:31.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a7fc65-902f-4303-9699-a5dc23942bea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:31.323Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=02a7fc65-902f-4303-9699-a5dc23942bea ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:18:31.323Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=02a7fc65-902f-4303-9699-a5dc23942bea ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:18:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:18:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:42.038Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c0ac6761-c4ca-4e9e-a693-628ddb022405 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 lock resource with id 2643c492-64fd-4595-b688-a6e2298f56b6 2021-04-14T11:18:42.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9570673-f9f9-45ec-8d92-84e6e78387e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:42.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9570673-f9f9-45ec-8d92-84e6e78387e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b155069 2021-04-14T11:18:42.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9570673-f9f9-45ec-8d92-84e6e78387e8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:42.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9570673-f9f9-45ec-8d92-84e6e78387e8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:42.329Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:18:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:45.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:18:45.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0a5685-3c9c-4ba8-b464-84b17f8aadfd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:45.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0a5685-3c9c-4ba8-b464-84b17f8aadfd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e1803ec 2021-04-14T11:18:45.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0a5685-3c9c-4ba8-b464-84b17f8aadfd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:45.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0a5685-3c9c-4ba8-b464-84b17f8aadfd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:47.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0368eab-2865-4c1f-832e-eb2fbead5525 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:47.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0368eab-2865-4c1f-832e-eb2fbead5525 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b894cbc 2021-04-14T11:18:47.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0368eab-2865-4c1f-832e-eb2fbead5525 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:47.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0368eab-2865-4c1f-832e-eb2fbead5525 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:47.796Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a0368eab-2865-4c1f-832e-eb2fbead5525 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:18:47.796Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=a0368eab-2865-4c1f-832e-eb2fbead5525 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:18:48.044Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:18:48.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e206a645-3adc-4fe2-9211-4e070a62af7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:48.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e206a645-3adc-4fe2-9211-4e070a62af7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45403942 2021-04-14T11:18:48.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e206a645-3adc-4fe2-9211-4e070a62af7d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:48.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e206a645-3adc-4fe2-9211-4e070a62af7d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:49.928Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCp-template.yml,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a3d07cc3-d163-4b1b-a057-9645d5c83a1c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 Starting to create Csar for component VDU Cp 2021-04-14T11:18:50.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:18:50.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@201fbbf2 2021-04-14T11:18:50.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:18:50.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:18:50.146Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCp-template.yml,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a3d07cc3-d163-4b1b-a057-9645d5c83a1c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 Ended create Csar for component VDU Cp 2021-04-14T11:18:50.146Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCp-template.yml,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a3d07cc3-d163-4b1b-a057-9645d5c83a1c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 lock resource with id 2643c492-64fd-4595-b688-a6e2298f56b6 2021-04-14T11:18:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:51.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:18:53.145Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:18:53.146Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:18:53.146Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:18:53.146Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e8a7fe4a-10bf-45dc-8ee3-9031bd7aa7aa ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:18:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:18:56.146Z [qtp580718781-11] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCp-template.yml,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a3d07cc3-d163-4b1b-a057-9645d5c83a1c TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 Lock write succeeded but took too long: duration PT5.835679S exceeded limit PT0.5S 2021-04-14T11:18:56.882Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:19:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:19:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:19:03.734Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:19:04.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4fc58e5-23fe-4fae-ba91-122a17412ba5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:04.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4fc58e5-23fe-4fae-ba91-122a17412ba5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cc1bafc 2021-04-14T11:19:04.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4fc58e5-23fe-4fae-ba91-122a17412ba5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:04.172Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4fc58e5-23fe-4fae-ba91-122a17412ba5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:19:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:19:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:19:04.872Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:19:04.873Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:19:04.873Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:19:05.097Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c4fc58e5-23fe-4fae-ba91-122a17412ba5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:19:05.097Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=c4fc58e5-23fe-4fae-ba91-122a17412ba5 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:19:05.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f118b2-ed85-49bf-8cff-fee76054e52b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:05.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f118b2-ed85-49bf-8cff-fee76054e52b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@792241a2 2021-04-14T11:19:05.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f118b2-ed85-49bf-8cff-fee76054e52b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:05.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71f118b2-ed85-49bf-8cff-fee76054e52b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:06.394Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=71f118b2-ed85-49bf-8cff-fee76054e52b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:19:06.394Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=71f118b2-ed85-49bf-8cff-fee76054e52b ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:19:07.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b4e56c-7555-4343-8b1b-75f8dec8939d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:07.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b4e56c-7555-4343-8b1b-75f8dec8939d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@243fb55f 2021-04-14T11:19:07.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b4e56c-7555-4343-8b1b-75f8dec8939d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:07.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b4e56c-7555-4343-8b1b-75f8dec8939d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:08.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ab5203-f3e8-42a8-9bd4-ca4448870a7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:08.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ab5203-f3e8-42a8-9bd4-ca4448870a7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5558fd7e 2021-04-14T11:19:08.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ab5203-f3e8-42a8-9bd4-ca4448870a7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:08.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ab5203-f3e8-42a8-9bd4-ca4448870a7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:09.598Z [qtp580718781-11] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduCp-csar.csar,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=11d2ccc6-82a3-4cac-b427-011b7eabef97 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 Temporary storage failure while checking locks org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.getSliceWithRetries(ConsistentKeyLocker.java:464) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:426) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:175) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:154) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.jsongraph.JanusGraphDao.commit(JanusGraphDao.java:65) at org.openecomp.sdc.be.components.impl.BaseBusinessLogic.unlockComponent(BaseBusinessLogic.java:285) at org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic.lockComponentAndUpdateArtifact(ArtifactsBusinessLogic.java:916) at org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic.lambda$generateAndSaveToscaArtifact$2(ArtifactsBusinessLogic.java:359) at fj.data.Either$LeftProjection.bind(Either.java:287) at org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic.generateAndSaveToscaArtifact(ArtifactsBusinessLogic.java:354) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.saveToscaArtifactPayload(ComponentBusinessLogic.java:546) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.lambda$populateToscaArtifacts$1(ComponentBusinessLogic.java:492) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.saveToscaArtifactAndPopulateToscaArtifactsWithResult(ComponentBusinessLogic.java:508) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.populateToscaArtifacts(ComponentBusinessLogic.java:490) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.populateToscaArtifacts(ComponentBusinessLogic.java:470) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.propagateStateToCertified(ResourceBusinessLogic.java:3845) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:231) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:19:11.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb954ea-b103-4f14-99d6-b77f8eb3d730 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:11.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb954ea-b103-4f14-99d6-b77f8eb3d730 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fc5e5f4 2021-04-14T11:19:11.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb954ea-b103-4f14-99d6-b77f8eb3d730 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:11.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb954ea-b103-4f14-99d6-b77f8eb3d730 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:11.630Z [qtp580718781-11] WARN o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduCp-csar.csar,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=11d2ccc6-82a3-4cac-b427-011b7eabef97 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 #uploadMultipart('multipart', /tmp/rep12320794137081932861tmp, 'form-data; filename="vduCp.zip"; name="resourceZip"', '{"payloadName": "vduCp.yml", "contactId": "jh0003", "name": "VDU Cp", "description": "VDU Cp", "resourceIconPath": "port", "resourceType": "CP", "categories": [{"name": "Generic", "subcategories": [{"name": "Network Elements"}]}], "tags": ["VDU Cp"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): org.apache.cxf.jaxrs.impl.ResponseImpl@531f133d in 1.01min (too slow!) 2021-04-14T11:19:11.631Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c0ac6761-c4ca-4e9e-a693-628ddb022405" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduCp-csar.csar,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=60398 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=11d2ccc6-82a3-4cac-b427-011b7eabef97 TargetServiceName=null EntryTimestamp=2021-04-14T11:18:11.232Z InvocationID=01110c3d-c054-4d14-a31c-7d04aa4354c2 ErrorCode=500 LogTimestamp=2021-04-14T11:19:11.630744Z ResponseDesc=Created Exiting. 2021-04-14T11:19:11.631Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:19:11.714Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=63e633fd-39ab-4195-af9b-e2be44427ec7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:11.713868Z InvocationID=d0225b90-4c69-499d-a457-5cce9fa650c4 LogTimestamp=2021-04-14T11:19:11.713914Z Entering 2021-04-14T11:19:11.714Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=63e633fd-39ab-4195-af9b-e2be44427ec7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:11.713868Z InvocationID=d0225b90-4c69-499d-a457-5cce9fa650c4 LogTimestamp=2021-04-14T11:19:11.713914Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:19:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a97f14b6-7886-4afa-ad17-632b941eff07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a97f14b6-7886-4afa-ad17-632b941eff07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64018aff 2021-04-14T11:19:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a97f14b6-7886-4afa-ad17-632b941eff07 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:13.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a97f14b6-7886-4afa-ad17-632b941eff07 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:15.927Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:15.928Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:15.928Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:15.928Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:16.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cdace3d-7006-4979-ba08-4b9fbaea9717 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:16.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cdace3d-7006-4979-ba08-4b9fbaea9717 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d4d5e6d 2021-04-14T11:19:16.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cdace3d-7006-4979-ba08-4b9fbaea9717 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:16.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cdace3d-7006-4979-ba08-4b9fbaea9717 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:16.103Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Vnf 2021-04-14T11:19:17.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493eb52f-4f9b-4552-84d4-7fb23c0ed666 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:17.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493eb52f-4f9b-4552-84d4-7fb23c0ed666 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f6cf7b7 2021-04-14T11:19:17.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493eb52f-4f9b-4552-84d4-7fb23c0ed666 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:17.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493eb52f-4f9b-4552-84d4-7fb23c0ed666 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:17.901Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8324e64-827f-49dd-97b2-16a59e1ce778 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:17.901Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8324e64-827f-49dd-97b2-16a59e1ce778 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f265deb 2021-04-14T11:19:17.901Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8324e64-827f-49dd-97b2-16a59e1ce778 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:17.901Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8324e64-827f-49dd-97b2-16a59e1ce778 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:18.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06a2490-e860-4357-91ad-85cbc4cb6ebf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:18.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06a2490-e860-4357-91ad-85cbc4cb6ebf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67186882 2021-04-14T11:19:18.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06a2490-e860-4357-91ad-85cbc4cb6ebf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:18.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d06a2490-e860-4357-91ad-85cbc4cb6ebf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:21.141Z [qtp580718781-15] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=70738eba-e937-4614-84cd-9770c9f754ae EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:19:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32080019-805d-4f90-b537-69f1a71f832a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32080019-805d-4f90-b537-69f1a71f832a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3071fc3a 2021-04-14T11:19:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32080019-805d-4f90-b537-69f1a71f832a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:21.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32080019-805d-4f90-b537-69f1a71f832a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:21.457Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=70738eba-e937-4614-84cd-9770c9f754ae EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:19:21.458Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=70738eba-e937-4614-84cd-9770c9f754ae TargetServiceName=null EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:19:22.455Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=70738eba-e937-4614-84cd-9770c9f754ae TargetServiceName=null EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 ErrorCode=500 lock resource with id fea4834c-d2a8-4e24-b3d5-1bd59d08ced9 2021-04-14T11:19:25.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a11c8435-1734-4cc9-960d-09c18ab7c4af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:25.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a11c8435-1734-4cc9-960d-09c18ab7c4af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78e864cc 2021-04-14T11:19:25.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a11c8435-1734-4cc9-960d-09c18ab7c4af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:25.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a11c8435-1734-4cc9-960d-09c18ab7c4af PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:26.910Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=75336ea7-53d2-4916-9b40-d090a80d9023 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 ErrorCode=500 Starting to create Csar for component VNF 2021-04-14T11:19:27.261Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=75336ea7-53d2-4916-9b40-d090a80d9023 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 ErrorCode=500 Ended create Csar for component VNF 2021-04-14T11:19:27.262Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=75336ea7-53d2-4916-9b40-d090a80d9023 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 ErrorCode=500 lock resource with id fea4834c-d2a8-4e24-b3d5-1bd59d08ced9 2021-04-14T11:19:27.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45501f36-d8f1-463b-8dcc-950c996923ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:27.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45501f36-d8f1-463b-8dcc-950c996923ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@459ca73f 2021-04-14T11:19:27.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45501f36-d8f1-463b-8dcc-950c996923ff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:27.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45501f36-d8f1-463b-8dcc-950c996923ff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:28.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206a931f-b52c-4789-8878-458c762d5391 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:28.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206a931f-b52c-4789-8878-458c762d5391 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61e49b76 2021-04-14T11:19:28.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206a931f-b52c-4789-8878-458c762d5391 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:28.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=206a931f-b52c-4789-8878-458c762d5391 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:30.472Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "70738eba-e937-4614-84cd-9770c9f754ae" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscacsar" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Vnf-csar.csar,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=18758 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e3292ac6-f728-429a-a56c-10298b98216f TargetServiceName=null EntryTimestamp=2021-04-14T11:19:11.714Z InvocationID=7b9ae016-1597-4876-a41d-1379323fda22 ErrorCode=500 LogTimestamp=2021-04-14T11:19:30.472161Z ResponseDesc=Created Exiting. 2021-04-14T11:19:30.473Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:19:30.535Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=abe54d02-b140-440b-abf2-82a0ee3cc269 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:30.535113Z InvocationID=07dca932-dad9-4ffa-8a1e-1df2f95fac2e LogTimestamp=2021-04-14T11:19:30.535154Z Entering 2021-04-14T11:19:30.535Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=abe54d02-b140-440b-abf2-82a0ee3cc269 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:30.535113Z InvocationID=07dca932-dad9-4ffa-8a1e-1df2f95fac2e LogTimestamp=2021-04-14T11:19:30.535154Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:19:30.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0a930d9-d740-4b41-a1f9-e272ca985921 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:30.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0a930d9-d740-4b41-a1f9-e272ca985921 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ecb3b5c 2021-04-14T11:19:30.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0a930d9-d740-4b41-a1f9-e272ca985921 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:30.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0a930d9-d740-4b41-a1f9-e272ca985921 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:32.927Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:32.928Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:32.929Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:32.929Z [qtp580718781-12] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:33.043Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name AccessConnectivity 2021-04-14T11:19:33.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e1fd4f9-00eb-4eba-a330-c7c08dc96355 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:33.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e1fd4f9-00eb-4eba-a330-c7c08dc96355 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@653efa4d 2021-04-14T11:19:33.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e1fd4f9-00eb-4eba-a330-c7c08dc96355 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:33.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e1fd4f9-00eb-4eba-a330-c7c08dc96355 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:36.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=784144a3-3984-4f06-ab71-7438d60cdf2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:36.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=784144a3-3984-4f06-ab71-7438d60cdf2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45bb0c8a 2021-04-14T11:19:36.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=784144a3-3984-4f06-ab71-7438d60cdf2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:36.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=784144a3-3984-4f06-ab71-7438d60cdf2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:38.439Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.accessConnectivity" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a5fd35c-208d-4d55-8af7-eddb45a57f6b EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:19:38.440Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.accessConnectivity" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a5fd35c-208d-4d55-8af7-eddb45a57f6b TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:19:39.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f9bc1b-d1f9-4c83-b621-e0254fc37b20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:39.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f9bc1b-d1f9-4c83-b621-e0254fc37b20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@411060 2021-04-14T11:19:39.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f9bc1b-d1f9-4c83-b621-e0254fc37b20 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:39.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c8f9bc1b-d1f9-4c83-b621-e0254fc37b20 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:40.043Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.accessConnectivity" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1a5fd35c-208d-4d55-8af7-eddb45a57f6b TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 lock resource with id 4b93e574-020e-411e-9eaa-5cd9ddfe2ecd 2021-04-14T11:19:42.541Z [qtp580718781-12] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" CURR_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-AccessConnectivity-template.yml,0,4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate,0 " STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f657690-d245-4880-a4f6-358272a9b523 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 Lock write succeeded but took too long: duration PT0.706781S exceeded limit PT0.5S 2021-04-14T11:19:42.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5fc8d8b-7fd6-4b00-bd5d-189c4d1dd5de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:42.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5fc8d8b-7fd6-4b00-bd5d-189c4d1dd5de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@757caef 2021-04-14T11:19:42.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5fc8d8b-7fd6-4b00-bd5d-189c4d1dd5de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:42.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5fc8d8b-7fd6-4b00-bd5d-189c4d1dd5de PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:43.210Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" CURR_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-AccessConnectivity-template.yml,0,4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f657690-d245-4880-a4f6-358272a9b523 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 Starting to create Csar for component Access Connectivity 2021-04-14T11:19:43.391Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" CURR_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-AccessConnectivity-template.yml,0,4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f657690-d245-4880-a4f6-358272a9b523 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 Ended create Csar for component Access Connectivity 2021-04-14T11:19:43.391Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" CURR_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-AccessConnectivity-template.yml,0,4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f657690-d245-4880-a4f6-358272a9b523 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 lock resource with id 4b93e574-020e-411e-9eaa-5cd9ddfe2ecd 2021-04-14T11:19:45.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd24ae0-ca9c-42d9-abec-0081ba6856a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:45.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd24ae0-ca9c-42d9-abec-0081ba6856a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1529a4da 2021-04-14T11:19:45.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd24ae0-ca9c-42d9-abec-0081ba6856a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:45.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd24ae0-ca9c-42d9-abec-0081ba6856a7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:46.118Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Access Connectivity" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "1a5fd35c-208d-4d55-8af7-eddb45a57f6b" INVARIANT_UUID = "b3332109-f3e3-4091-a2ef-7b59b1dabe3c" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscacsar" CURR_ARTIFACT_UUID = "4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-AccessConnectivity-csar.csar,0,4b93e574-020e-411e-9eaa-5cd9ddfe2ecd.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=15582 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4c35afab-254b-41de-beeb-f5014e26ca49 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:30.535Z InvocationID=fbd00720-6378-4253-b3a6-e97c5591c576 ErrorCode=500 LogTimestamp=2021-04-14T11:19:46.117697Z ResponseDesc=Created Exiting. 2021-04-14T11:19:46.118Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:19:46.240Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ee0532e5-510b-48ae-8cc3-1c4893d4a262 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:46.239727Z InvocationID=141405a5-1949-47a6-b74c-fcf758e8b02d LogTimestamp=2021-04-14T11:19:46.239779Z Entering 2021-04-14T11:19:46.240Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ee0532e5-510b-48ae-8cc3-1c4893d4a262 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:46.239727Z InvocationID=141405a5-1949-47a6-b74c-fcf758e8b02d LogTimestamp=2021-04-14T11:19:46.239779Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:19:47.870Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7da206dc-ba59-4ad3-a1f0-b33fdfac4996 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:47.869641Z InvocationID=2f6728e0-70b1-43c6-b133-30285678e35b LogTimestamp=2021-04-14T11:19:47.869722Z Entering 2021-04-14T11:19:47.870Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7da206dc-ba59-4ad3-a1f0-b33fdfac4996 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:19:47.869641Z InvocationID=2f6728e0-70b1-43c6-b133-30285678e35b LogTimestamp=2021-04-14T11:19:47.869722Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:19:47.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8fd051-7b60-4cf3-92c2-2739819f65a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:47.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8fd051-7b60-4cf3-92c2-2739819f65a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@86b25a9 2021-04-14T11:19:47.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8fd051-7b60-4cf3-92c2-2739819f65a8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:47.871Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8fd051-7b60-4cf3-92c2-2739819f65a8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:47.872Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:19:47.870Z InvocationID=fec0d3fa-d9b2-4d79-beb6-62578d88723a LogTimestamp=2021-04-14T11:19:47.872189Z ResponseDesc=OK Exiting. 2021-04-14T11:19:47.872Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:19:51.213Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:51.213Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:51.213Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:51.213Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:19:51.431Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Ontpnf 2021-04-14T11:19:51.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeaad89-0e07-4fa6-b5af-ae31f3479dba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:51.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeaad89-0e07-4fa6-b5af-ae31f3479dba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21e6d4 2021-04-14T11:19:51.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeaad89-0e07-4fa6-b5af-ae31f3479dba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:51.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeaad89-0e07-4fa6-b5af-ae31f3479dba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:19:54.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:19:55.152Z [qtp580718781-11] WARN o.j.d.l.c.ConsistentKeyLocker RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary storage failure while checking locks org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.getSliceWithRetries(ConsistentKeyLocker.java:464) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:426) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:175) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:154) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.lockNode(JanusGraphGenericDao.java:1265) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.lockElement(JanusGraphGenericDao.java:1249) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.lockComponentByName(GraphLockOperation.java:87) at org.openecomp.sdc.be.components.impl.BaseBusinessLogic.lockComponentByName(BaseBusinessLogic.java:527) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4419) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:19:55.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97406dd6-c9f2-4118-af4e-678378f8b438 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:55.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97406dd6-c9f2-4118-af4e-678378f8b438 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3918548d 2021-04-14T11:19:55.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97406dd6-c9f2-4118-af4e-678378f8b438 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:55.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97406dd6-c9f2-4118-af4e-678378f8b438 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:56.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5b5d656-59b0-4156-b3ab-371e31dd320a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:19:56.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5b5d656-59b0-4156-b3ab-371e31dd320a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@614f2800 2021-04-14T11:19:56.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5b5d656-59b0-4156-b3ab-371e31dd320a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:19:56.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5b5d656-59b0-4156-b3ab-371e31dd320a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:19:57.026Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:19:57.394Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e5b5d656-59b0-4156-b3ab-371e31dd320a ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:19:57.394Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=e5b5d656-59b0-4156-b3ab-371e31dd320a ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:19:58.604Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.OntPnf" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ef679512-3619-42d6-b68b-5c17d32d5912 EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:19:58.605Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.OntPnf" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ef679512-3619-42d6-b68b-5c17d32d5912 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:20:00.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a867983-1a83-45be-9717-db165c4a8b08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:00.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a867983-1a83-45be-9717-db165c4a8b08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30d80fed 2021-04-14T11:20:00.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a867983-1a83-45be-9717-db165c4a8b08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:00.443Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a867983-1a83-45be-9717-db165c4a8b08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:00.542Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.vfc.OntPnf" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ef679512-3619-42d6-b68b-5c17d32d5912 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 ErrorCode=500 lock resource with id bdecb850-fd59-42e6-8805-b36999214048 2021-04-14T11:20:01.483Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6a867983-1a83-45be-9717-db165c4a8b08 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:20:01.484Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6a867983-1a83-45be-9717-db165c4a8b08 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:20:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=733c4f5f-0083-4684-b748-8340ed0116cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=733c4f5f-0083-4684-b748-8340ed0116cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fc04864 2021-04-14T11:20:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=733c4f5f-0083-4684-b748-8340ed0116cb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=733c4f5f-0083-4684-b748-8340ed0116cb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:02.839Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate" CURR_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ontpnf-template.yml,0,bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d23d6f7-ec07-44ab-b2c5-056e383ec081 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 ErrorCode=500 Starting to create Csar for component OntPnf 2021-04-14T11:20:03.090Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate" CURR_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ontpnf-template.yml,0,bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d23d6f7-ec07-44ab-b2c5-056e383ec081 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 ErrorCode=500 Ended create Csar for component OntPnf 2021-04-14T11:20:03.091Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate" CURR_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ontpnf-template.yml,0,bdecb850-fd59-42e6-8805-b36999214048.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6d23d6f7-ec07-44ab-b2c5-056e383ec081 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 ErrorCode=500 lock resource with id bdecb850-fd59-42e6-8805-b36999214048 2021-04-14T11:20:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:20:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:20:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:20:04.375Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:20:04.375Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:20:04.375Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:20:05.192Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntPnf" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ef679512-3619-42d6-b68b-5c17d32d5912" INVARIANT_UUID = "abc5c281-09e3-4626-a7d1-359418b2f689" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscacsar" CURR_ARTIFACT_UUID = "bdecb850-fd59-42e6-8805-b36999214048.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Ontpnf-csar.csar,0,bdecb850-fd59-42e6-8805-b36999214048.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=18949 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1fda4f17-211b-476b-9fc5-510ddd8c5fb9 TargetServiceName=null EntryTimestamp=2021-04-14T11:19:46.242Z InvocationID=3e212528-2ffa-441b-bf6a-e8e40d8531a2 ErrorCode=500 LogTimestamp=2021-04-14T11:20:05.191456Z ResponseDesc=Created Exiting. 2021-04-14T11:20:05.192Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:20:05.215Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e4a13414-35a8-4ce8-9b6d-d9a93ca0e96b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:20:05.215062Z InvocationID=f8d3cb4c-12c6-444d-a7bc-06eda2b3b4a4 LogTimestamp=2021-04-14T11:20:05.215108Z Entering 2021-04-14T11:20:05.215Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e4a13414-35a8-4ce8-9b6d-d9a93ca0e96b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:20:05.215062Z InvocationID=f8d3cb4c-12c6-444d-a7bc-06eda2b3b4a4 LogTimestamp=2021-04-14T11:20:05.215108Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:20:06.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33cc7ae0-7a10-494a-9541-7f5f749fa493 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:06.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33cc7ae0-7a10-494a-9541-7f5f749fa493 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4487df2d 2021-04-14T11:20:06.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33cc7ae0-7a10-494a-9541-7f5f749fa493 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:06.438Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33cc7ae0-7a10-494a-9541-7f5f749fa493 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de8f5ba-2432-48c2-96ef-a0dddad33f24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de8f5ba-2432-48c2-96ef-a0dddad33f24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c90f095 2021-04-14T11:20:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de8f5ba-2432-48c2-96ef-a0dddad33f24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de8f5ba-2432-48c2-96ef-a0dddad33f24 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:10.138Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:10.138Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:10.138Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:10.138Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:10.334Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Ponuni 2021-04-14T11:20:12.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e10fce2-20b1-4750-a5cb-042a03af9514 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:12.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e10fce2-20b1-4750-a5cb-042a03af9514 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c473b8d 2021-04-14T11:20:12.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e10fce2-20b1-4750-a5cb-042a03af9514 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:12.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e10fce2-20b1-4750-a5cb-042a03af9514 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:14.418Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.PonUni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d11bc399-41f4-40b3-8477-82d8ad608441 EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:20:14.419Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.PonUni" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d11bc399-41f4-40b3-8477-82d8ad608441 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:20:15.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77dc2060-240f-4b6f-9c73-7ad2e210f7ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:15.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77dc2060-240f-4b6f-9c73-7ad2e210f7ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1179d509 2021-04-14T11:20:15.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77dc2060-240f-4b6f-9c73-7ad2e210f7ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:15.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77dc2060-240f-4b6f-9c73-7ad2e210f7ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:17.042Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.PonUni" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d11bc399-41f4-40b3-8477-82d8ad608441 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 ErrorCode=500 lock resource with id 12afab53-a2ce-413b-bf0c-4827f88a2f82 2021-04-14T11:20:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aab9349-1047-4c83-9fd5-87149da16ee2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aab9349-1047-4c83-9fd5-87149da16ee2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b7d0ebc 2021-04-14T11:20:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aab9349-1047-4c83-9fd5-87149da16ee2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aab9349-1047-4c83-9fd5-87149da16ee2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:19.461Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate" CURR_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ponuni-template.yml,0,12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3f9f7623-cf9c-48f1-a3c0-f439c218e51b TargetServiceName=null EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 ErrorCode=500 Starting to create Csar for component PonUni 2021-04-14T11:20:19.644Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate" CURR_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ponuni-template.yml,0,12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3f9f7623-cf9c-48f1-a3c0-f439c218e51b TargetServiceName=null EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 ErrorCode=500 Ended create Csar for component PonUni 2021-04-14T11:20:19.644Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate" CURR_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ponuni-template.yml,0,12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3f9f7623-cf9c-48f1-a3c0-f439c218e51b TargetServiceName=null EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 ErrorCode=500 lock resource with id 12afab53-a2ce-413b-bf0c-4827f88a2f82 2021-04-14T11:20:21.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f290247-9498-4d14-a9a5-eb6f4829ca81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:21.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f290247-9498-4d14-a9a5-eb6f4829ca81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30b25f1e 2021-04-14T11:20:21.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f290247-9498-4d14-a9a5-eb6f4829ca81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:21.053Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f290247-9498-4d14-a9a5-eb6f4829ca81 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:21.566Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "PonUni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d11bc399-41f4-40b3-8477-82d8ad608441" INVARIANT_UUID = "f376e4cf-18f0-4b3d-bf87-dd63e0b3ec3d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscacsar" CURR_ARTIFACT_UUID = "12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Ponuni-csar.csar,0,12afab53-a2ce-413b-bf0c-4827f88a2f82.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=16351 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5671116b-a946-4218-b532-5282e73a751e TargetServiceName=null EntryTimestamp=2021-04-14T11:20:05.215Z InvocationID=fac579d3-25ab-4732-afb4-10a9a47b7c45 ErrorCode=500 LogTimestamp=2021-04-14T11:20:21.566362Z ResponseDesc=Created Exiting. 2021-04-14T11:20:21.566Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:20:21.582Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=00e351a7-f44e-43ff-b0e4-abfd0cb3fd80 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:20:21.582180Z InvocationID=2ae8169c-6d07-4082-ba18-96d98d4486d6 LogTimestamp=2021-04-14T11:20:21.582218Z Entering 2021-04-14T11:20:21.582Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=00e351a7-f44e-43ff-b0e4-abfd0cb3fd80 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:20:21.582180Z InvocationID=2ae8169c-6d07-4082-ba18-96d98d4486d6 LogTimestamp=2021-04-14T11:20:21.582218Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:20:22.289Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:22.289Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:22.289Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:22.289Z [qtp580718781-18] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:22.358Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Oltnni 2021-04-14T11:20:24.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a18db9d6-5196-4b87-8db5-2db6fbfe26bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:24.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a18db9d6-5196-4b87-8db5-2db6fbfe26bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@253c91d6 2021-04-14T11:20:24.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a18db9d6-5196-4b87-8db5-2db6fbfe26bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:24.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a18db9d6-5196-4b87-8db5-2db6fbfe26bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:24.940Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OltNni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=56f2c302-efcc-4338-b576-6436c032aca4 EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:20:24.941Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OltNni" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=56f2c302-efcc-4338-b576-6436c032aca4 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:20:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1248cbc4-5e82-4148-943a-650f058a0f16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1248cbc4-5e82-4148-943a-650f058a0f16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ab2d9e5 2021-04-14T11:20:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1248cbc4-5e82-4148-943a-650f058a0f16 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1248cbc4-5e82-4148-943a-650f058a0f16 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:28.540Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OltNni" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=56f2c302-efcc-4338-b576-6436c032aca4 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 ErrorCode=500 lock resource with id 6bdd964c-6f38-4709-a280-c488d0dff81c 2021-04-14T11:20:30.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c1b204-9c2b-4639-b5dc-8aca4a56b1fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:30.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c1b204-9c2b-4639-b5dc-8aca4a56b1fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79b930e1 2021-04-14T11:20:30.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c1b204-9c2b-4639-b5dc-8aca4a56b1fd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:30.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c1b204-9c2b-4639-b5dc-8aca4a56b1fd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:31.611Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate" CURR_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oltnni-template.yml,0,6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f18c831-1dea-4a02-bfcf-8b3ba38a0e17 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 ErrorCode=500 Starting to create Csar for component OltNni 2021-04-14T11:20:31.823Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate" CURR_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oltnni-template.yml,0,6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f18c831-1dea-4a02-bfcf-8b3ba38a0e17 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 ErrorCode=500 Ended create Csar for component OltNni 2021-04-14T11:20:31.824Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate" CURR_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oltnni-template.yml,0,6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f18c831-1dea-4a02-bfcf-8b3ba38a0e17 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 ErrorCode=500 lock resource with id 6bdd964c-6f38-4709-a280-c488d0dff81c 2021-04-14T11:20:33.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6772b700-280c-4bbe-a1e4-9b44fead838a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:33.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6772b700-280c-4bbe-a1e4-9b44fead838a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b51da67 2021-04-14T11:20:33.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6772b700-280c-4bbe-a1e4-9b44fead838a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:33.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6772b700-280c-4bbe-a1e4-9b44fead838a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:34.494Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OltNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "56f2c302-efcc-4338-b576-6436c032aca4" INVARIANT_UUID = "4e5e49c2-2bd6-4455-9863-e1612b8dd2c4" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscacsar" CURR_ARTIFACT_UUID = "6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Oltnni-csar.csar,0,6bdd964c-6f38-4709-a280-c488d0dff81c.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=12912 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=598cdeb0-ce02-458e-af92-da97c89ceefe TargetServiceName=null EntryTimestamp=2021-04-14T11:20:21.582Z InvocationID=bdcdc9c9-157d-45e5-b1fa-66e7351c1482 ErrorCode=500 LogTimestamp=2021-04-14T11:20:34.494157Z ResponseDesc=Created Exiting. 2021-04-14T11:20:34.494Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:20:34.642Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2d0ad05d-4b97-4e0d-86bd-4ef986859a57 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:20:34.642185Z InvocationID=f0384cd1-b057-4f0c-8644-ccaf632349aa LogTimestamp=2021-04-14T11:20:34.642243Z Entering 2021-04-14T11:20:34.642Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2d0ad05d-4b97-4e0d-86bd-4ef986859a57 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:20:34.642185Z InvocationID=f0384cd1-b057-4f0c-8644-ccaf632349aa LogTimestamp=2021-04-14T11:20:34.642243Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:20:36.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14df5cef-8488-43e0-bd28-074061427527 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:36.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14df5cef-8488-43e0-bd28-074061427527 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a2252fa 2021-04-14T11:20:36.143Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14df5cef-8488-43e0-bd28-074061427527 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:36.143Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14df5cef-8488-43e0-bd28-074061427527 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:37.635Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:37.635Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:37.635Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:37.635Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:20:37.883Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Ontnni 2021-04-14T11:20:44.567Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a95d51-4124-49e0-830b-6990da197bef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:44.567Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a95d51-4124-49e0-830b-6990da197bef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76b3ddaa 2021-04-14T11:20:44.567Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a95d51-4124-49e0-830b-6990da197bef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:44.567Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07a95d51-4124-49e0-830b-6990da197bef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:47.576Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=07a95d51-4124-49e0-830b-6990da197bef ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:20:47.576Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=07a95d51-4124-49e0-830b-6990da197bef ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:20:47.576Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07a95d51-4124-49e0-830b-6990da197bef ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:20:47.577Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=07a95d51-4124-49e0-830b-6990da197bef ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:20:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:20:48.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:20:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:20:52.260Z [qtp580718781-19] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during lock write org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:363) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.tryWriteLockOnce(ConsistentKeyLocker.java:387) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.writeSingleLock(ConsistentKeyLocker.java:324) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.writeSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.writeLock(AbstractLocker.java:304) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStore.acquireLock(ExpectedValueCheckingStore.java:103) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.acquireLock(KCVSProxy.java:52) at org.janusgraph.diskstorage.BackendTransaction.acquireIndexLock(BackendTransaction.java:256) at org.janusgraph.graphdb.database.StandardJanusGraph.prepareCommit(StandardJanusGraph.java:577) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:717) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:20:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=624f1f3a-c0c3-4250-ad70-fd86946d9002 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:20:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=624f1f3a-c0c3-4250-ad70-fd86946d9002 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@463dc5a5 2021-04-14T11:20:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=624f1f3a-c0c3-4250-ad70-fd86946d9002 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:20:56.248Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=624f1f3a-c0c3-4250-ad70-fd86946d9002 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:20:56.343Z [qtp580718781-19] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary storage failure while checking locks org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.getSliceWithRetries(ConsistentKeyLocker.java:464) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:426) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:175) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:154) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:20:56.382Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:20:59.286Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=624f1f3a-c0c3-4250-ad70-fd86946d9002 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:20:59.286Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=624f1f3a-c0c3-4250-ad70-fd86946d9002 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:21:00.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de38c08-bd00-4df0-9fd5-dcae730219b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:00.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de38c08-bd00-4df0-9fd5-dcae730219b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b5798e2 2021-04-14T11:21:00.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de38c08-bd00-4df0-9fd5-dcae730219b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:00.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de38c08-bd00-4df0-9fd5-dcae730219b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:21:00.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:21:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:21:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:21:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:21:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:21:04.373Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:21:04.374Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:21:04.374Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:21:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:21:08.232Z [qtp580718781-19] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:21:08.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:08.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@736148af 2021-04-14T11:21:08.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:08.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:08.848Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:21:11.241Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:21:11.242Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:21:11.242Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:21:11.242Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=0bf12316-baa6-4f4d-bdfc-a28240940978 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:21:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:21:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:21:13.163Z [qtp580718781-19] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary storage exception while deleting lock org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:363) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.deleteSingleLock(ConsistentKeyLocker.java:538) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.deleteSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.deleteLocks(AbstractLocker.java:381) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStore.deleteLocks(ExpectedValueCheckingStore.java:115) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.deleteAllLocks(ExpectedValueCheckingTransaction.java:282) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.commit(ExpectedValueCheckingTransaction.java:92) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:197) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:21:13.929Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:21:13.931Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:21:14.899Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:21:14.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:14.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bd9bb8b 2021-04-14T11:21:14.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:14.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:18.321Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:21:18.321Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:21:18.321Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:21:18.321Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=334f5085-fd6b-452a-a023-071ccc6ee47e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:21:20.760Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "org.openecomp.resource.cp.OntNni" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 ErrorCode=500 lock resource with id f941339a-c529-4483-9822-7bba7c62d347 2021-04-14T11:21:20.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cae2d7a-d6a9-406f-b48e-eacecd547e17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:20.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cae2d7a-d6a9-406f-b48e-eacecd547e17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a2dbb4b 2021-04-14T11:21:20.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cae2d7a-d6a9-406f-b48e-eacecd547e17 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:20.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cae2d7a-d6a9-406f-b48e-eacecd547e17 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:23.958Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9cae2d7a-d6a9-406f-b48e-eacecd547e17 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:21:23.959Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9cae2d7a-d6a9-406f-b48e-eacecd547e17 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:21:25.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e9c0608-557b-4643-8b49-88f239f59a0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:25.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e9c0608-557b-4643-8b49-88f239f59a0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55634697 2021-04-14T11:21:25.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e9c0608-557b-4643-8b49-88f239f59a0d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:25.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e9c0608-557b-4643-8b49-88f239f59a0d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:25.659Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate" CURR_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ontnni-template.yml,0,f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=00c0a5b6-4e45-411c-bc08-ba1ce3d86688 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 ErrorCode=500 Starting to create Csar for component OntNni 2021-04-14T11:21:26.029Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate" CURR_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ontnni-template.yml,0,f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=00c0a5b6-4e45-411c-bc08-ba1ce3d86688 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 ErrorCode=500 Ended create Csar for component OntNni 2021-04-14T11:21:26.030Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate" CURR_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ontnni-template.yml,0,f941339a-c529-4483-9822-7bba7c62d347.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=00c0a5b6-4e45-411c-bc08-ba1ce3d86688 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 ErrorCode=500 lock resource with id f941339a-c529-4483-9822-7bba7c62d347 2021-04-14T11:21:28.552Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8e9c0608-557b-4643-8b49-88f239f59a0d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:21:28.552Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8e9c0608-557b-4643-8b49-88f239f59a0d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:21:28.590Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "OntNni" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "1b7ac11d-b09f-4e59-a1f0-dfb34b6506d6" INVARIANT_UUID = "beb242ce-3d6e-4c6a-866d-f029ce055d28" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscacsar" CURR_ARTIFACT_UUID = "f941339a-c529-4483-9822-7bba7c62d347.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Ontnni-csar.csar,0,f941339a-c529-4483-9822-7bba7c62d347.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=53947 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=664e102b-0437-487e-b818-4961a43fa5b3 TargetServiceName=null EntryTimestamp=2021-04-14T11:20:34.643Z InvocationID=87b7fc65-090f-4444-9945-ebc32d045873 ErrorCode=500 LogTimestamp=2021-04-14T11:21:28.590073Z ResponseDesc=Created Exiting. 2021-04-14T11:21:28.591Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:21:28.630Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=43b2072c-c0ac-438a-b3c5-2b3a091d3b7f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:21:28.630610Z InvocationID=9a2b555c-6ba6-48b9-ae64-31aff5210ab2 LogTimestamp=2021-04-14T11:21:28.630653Z Entering 2021-04-14T11:21:28.630Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=43b2072c-c0ac-438a-b3c5-2b3a091d3b7f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:21:28.630610Z InvocationID=9a2b555c-6ba6-48b9-ae64-31aff5210ab2 LogTimestamp=2021-04-14T11:21:28.630653Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:21:29.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57048b90-39a6-4d82-b5fc-1c6654d92162 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:29.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57048b90-39a6-4d82-b5fc-1c6654d92162 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a156507 2021-04-14T11:21:29.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57048b90-39a6-4d82-b5fc-1c6654d92162 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:29.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57048b90-39a6-4d82-b5fc-1c6654d92162 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:30.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=57048b90-39a6-4d82-b5fc-1c6654d92162 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:21:30.318Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=57048b90-39a6-4d82-b5fc-1c6654d92162 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:21:31.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45deb091-9036-4e5a-8cbc-82f48c21cec3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:31.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45deb091-9036-4e5a-8cbc-82f48c21cec3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43ffc001 2021-04-14T11:21:31.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45deb091-9036-4e5a-8cbc-82f48c21cec3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:31.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45deb091-9036-4e5a-8cbc-82f48c21cec3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:31.648Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:21:31.648Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:21:31.648Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:21:31.648Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:21:31.754Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Sap 2021-04-14T11:21:32.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5b11ddc-7c77-47f1-8846-0bff1bec30e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:32.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5b11ddc-7c77-47f1-8846-0bff1bec30e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@756c47dd 2021-04-14T11:21:32.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5b11ddc-7c77-47f1-8846-0bff1bec30e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:32.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5b11ddc-7c77-47f1-8846-0bff1bec30e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7ff13cd-43b5-481b-a138-f03db397375c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7ff13cd-43b5-481b-a138-f03db397375c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14b0292a 2021-04-14T11:21:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7ff13cd-43b5-481b-a138-f03db397375c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7ff13cd-43b5-481b-a138-f03db397375c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:39.093Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Sap" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4bb7dff1-b23a-4e94-8e0e-00edc5111359 EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:21:39.094Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Sap" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4bb7dff1-b23a-4e94-8e0e-00edc5111359 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:21:39.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7e44cf-a64e-44a2-8e94-9b68b16bc08e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:39.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7e44cf-a64e-44a2-8e94-9b68b16bc08e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2327c390 2021-04-14T11:21:39.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7e44cf-a64e-44a2-8e94-9b68b16bc08e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:39.371Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7e44cf-a64e-44a2-8e94-9b68b16bc08e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:40.153Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Read timed out; blacklisting for 2 minutes 2021-04-14T11:21:40.158Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:21:40.337Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Sap" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4bb7dff1-b23a-4e94-8e0e-00edc5111359 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=500 lock resource with id 5ec5eef7-24ca-4b31-b98e-161f30e25741 2021-04-14T11:21:40.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d22093-22ac-43b9-b626-10aa36a9d692 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:40.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d22093-22ac-43b9-b626-10aa36a9d692 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee5f03d 2021-04-14T11:21:40.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d22093-22ac-43b9-b626-10aa36a9d692 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:40.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d22093-22ac-43b9-b626-10aa36a9d692 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:42.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493ad657-483e-46d0-a401-3bf97c8f96d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:42.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493ad657-483e-46d0-a401-3bf97c8f96d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9a00e93 2021-04-14T11:21:42.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493ad657-483e-46d0-a401-3bf97c8f96d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:42.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=493ad657-483e-46d0-a401-3bf97c8f96d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:43.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=091fd64a-e132-4229-8251-55952c6dde9e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:43.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=091fd64a-e132-4229-8251-55952c6dde9e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c4c8ff4 2021-04-14T11:21:43.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=091fd64a-e132-4229-8251-55952c6dde9e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:43.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=091fd64a-e132-4229-8251-55952c6dde9e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:44.149Z [qtp580718781-15] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" CURR_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Sap-template.yml,0,5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate,0 " STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=500 Temporary storage failure while checking locks org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.getSliceWithRetries(ConsistentKeyLocker.java:464) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:426) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:175) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:154) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.jsongraph.JanusGraphDao.commit(JanusGraphDao.java:65) at org.openecomp.sdc.be.components.impl.BaseBusinessLogic.unlockComponent(BaseBusinessLogic.java:285) at org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic.lockComponentAndUpdateArtifact(ArtifactsBusinessLogic.java:916) at org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic.lambda$generateAndSaveToscaArtifact$2(ArtifactsBusinessLogic.java:359) at fj.data.Either$LeftProjection.bind(Either.java:287) at org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic.generateAndSaveToscaArtifact(ArtifactsBusinessLogic.java:354) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.saveToscaArtifactPayload(ComponentBusinessLogic.java:546) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.lambda$populateToscaArtifacts$0(ComponentBusinessLogic.java:486) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.saveToscaArtifactAndPopulateToscaArtifactsWithResult(ComponentBusinessLogic.java:508) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.populateToscaArtifacts(ComponentBusinessLogic.java:483) at org.openecomp.sdc.be.components.impl.ComponentBusinessLogic.populateToscaArtifacts(ComponentBusinessLogic.java:470) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.propagateStateToCertified(ResourceBusinessLogic.java:3845) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:231) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:21:45.582Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" CURR_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Sap-template.yml,0,5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=500 Starting to create Csar for component Sap 2021-04-14T11:21:45.739Z [qtp580718781-15] WARN o.o.s.e.AbstractSdncException AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" CURR_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Sap-template.yml,0,5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=900 Received less parameters than expected for error with messageId SVC4063, expected: 1, actual: 0. Missing parameters are padded with null values. 2021-04-14T11:21:45.739Z [qtp580718781-15] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" CURR_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Sap-template.yml,0,5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState - Certify ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=500 Unexpected error during operation 2021-04-14T11:21:45.740Z [qtp580718781-15] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "4bb7dff1-b23a-4e94-8e0e-00edc5111359" INVARIANT_UUID = "e83882f1-ce6e-4cb9-be64-3beedf786177" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" CURR_ARTIFACT_UUID = "5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Sap-template.yml,0,5ec5eef7-24ca-4b31-b98e-161f30e25741.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource Sap.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=500 Unexpected error during operation 2021-04-14T11:21:45.809Z [qtp580718781-15] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:21:45.811Z [qtp580718781-15] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=900 #uploadMultipart('multipart', /tmp/rep3440095918271782946tmp, 'form-data; filename="Sap.zip"; name="resourceZip"', '{"payloadName": "Sap.yml", "contactId": "jh0003", "name": "Sap", "description": "Sap", "resourceIconPath": "network", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Infrastructure"}]}], "vendorName": "ETSI", "vendorRelease": "2.5.1", "tags": ["Sap"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByResponseFormatComponentException out of org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic#lambda$decodeToscaArtifactPayload$4[382] in 17s 2021-04-14T11:21:45.812Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR ResponseCode=404 RequestID=null ElapsedTime=17181 PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=6580af46-7206-4e5e-84b9-bb08147156b1 TargetServiceName=null ErrorDesc=Not Found EntryTimestamp=2021-04-14T11:21:28.631Z InvocationID=723aa37b-f16e-4bb0-a3bb-ea110541ba20 ErrorCode=404 LogTimestamp=2021-04-14T11:21:45.812355Z ResponseDesc=Not Found Exiting. 2021-04-14T11:21:45.813Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="404" 2021-04-14T11:21:46.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cd11e3-8f56-4757-9a72-59aa24f03eeb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:46.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cd11e3-8f56-4757-9a72-59aa24f03eeb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16af4ae 2021-04-14T11:21:46.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cd11e3-8f56-4757-9a72-59aa24f03eeb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:46.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93cd11e3-8f56-4757-9a72-59aa24f03eeb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:49.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0872ca03-9ac0-433f-8e8f-eddcfb1dbd12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:49.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0872ca03-9ac0-433f-8e8f-eddcfb1dbd12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@303f88a6 2021-04-14T11:21:49.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0872ca03-9ac0-433f-8e8f-eddcfb1dbd12 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:49.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0872ca03-9ac0-433f-8e8f-eddcfb1dbd12 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:51.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e085af1a-1d46-4ca3-b1b1-0ea3ef02085b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:51.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e085af1a-1d46-4ca3-b1b1-0ea3ef02085b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39e2cca4 2021-04-14T11:21:51.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e085af1a-1d46-4ca3-b1b1-0ea3ef02085b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:51.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e085af1a-1d46-4ca3-b1b1-0ea3ef02085b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1343408c-316d-4be9-9bc1-1b894f04c7c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1343408c-316d-4be9-9bc1-1b894f04c7c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41a9d743 2021-04-14T11:21:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1343408c-316d-4be9-9bc1-1b894f04c7c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:52.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1343408c-316d-4be9-9bc1-1b894f04c7c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:54.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88fb6865-f704-4189-aab6-7269ed0a8189 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:54.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88fb6865-f704-4189-aab6-7269ed0a8189 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1730945c 2021-04-14T11:21:54.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88fb6865-f704-4189-aab6-7269ed0a8189 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:54.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88fb6865-f704-4189-aab6-7269ed0a8189 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:54.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb5c12e-d993-4b7e-a647-3d1ed8d72c4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:54.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb5c12e-d993-4b7e-a647-3d1ed8d72c4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b8654a4 2021-04-14T11:21:54.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb5c12e-d993-4b7e-a647-3d1ed8d72c4b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:54.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdb5c12e-d993-4b7e-a647-3d1ed8d72c4b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:56.819Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fbb84f66-914e-4fd3-910f-2c8855d25e9a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:21:56.819096Z InvocationID=8f7a70fa-9d88-4087-846e-48cd992ca5ae LogTimestamp=2021-04-14T11:21:56.819217Z Entering 2021-04-14T11:21:56.819Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fbb84f66-914e-4fd3-910f-2c8855d25e9a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:21:56.819096Z InvocationID=8f7a70fa-9d88-4087-846e-48cd992ca5ae LogTimestamp=2021-04-14T11:21:56.819217Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:21:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f7de778-d200-4d53-a282-8d96acd2fc2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f7de778-d200-4d53-a282-8d96acd2fc2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@742e249c 2021-04-14T11:21:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f7de778-d200-4d53-a282-8d96acd2fc2c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:57.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f7de778-d200-4d53-a282-8d96acd2fc2c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:57.995Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource Sap.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:21:56.820Z InvocationID=ea04c24a-f0df-4d4a-842a-cc0291cf92c6 ErrorCode=500 Unexpected error during operation 2021-04-14T11:21:58.013Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this Sap was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:21:56.820Z InvocationID=ea04c24a-f0df-4d4a-842a-cc0291cf92c6 ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:21:58.014Z [qtp580718781-17] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this Sap was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:21:56.820Z InvocationID=ea04c24a-f0df-4d4a-842a-cc0291cf92c6 ErrorCode=900 #uploadMultipart('multipart', /tmp/rep8302979663127407486tmp, 'form-data; filename="Sap.zip"; name="resourceZip"', '{"payloadName": "Sap.yml", "contactId": "jh0003", "name": "Sap", "description": "Sap", "resourceIconPath": "network", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Infrastructure"}]}], "vendorName": "ETSI", "vendorRelease": "2.5.1", "tags": ["Sap"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByActionStatusComponentException out of org.openecomp.sdc.be.components.impl.ResourceImportManager#importCertifiedResource[211] in 1s 2021-04-14T11:21:58.015Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Sap" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this Sap was already promoted." TOSCA_NODE_TYPE = "" ResponseCode=409 RequestID=null ElapsedTime=1195 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null ErrorDesc=Conflict EntryTimestamp=2021-04-14T11:21:56.820Z InvocationID=ea04c24a-f0df-4d4a-842a-cc0291cf92c6 ErrorCode=409 LogTimestamp=2021-04-14T11:21:58.015682Z ResponseDesc=Conflict Exiting. 2021-04-14T11:21:58.016Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="409" 2021-04-14T11:21:58.096Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=156130a6-5aae-484d-961f-683ca6b092d0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:21:58.096494Z InvocationID=0e3cec8a-8a03-4a86-ac9f-4f313e338d67 LogTimestamp=2021-04-14T11:21:58.096537Z Entering 2021-04-14T11:21:58.097Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=156130a6-5aae-484d-961f-683ca6b092d0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:21:58.096494Z InvocationID=0e3cec8a-8a03-4a86-ac9f-4f313e338d67 LogTimestamp=2021-04-14T11:21:58.096537Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:21:58.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a95a418e-bc09-4318-a4ea-10403c41b4ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:58.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a95a418e-bc09-4318-a4ea-10403c41b4ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b32e695 2021-04-14T11:21:58.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a95a418e-bc09-4318-a4ea-10403c41b4ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:58.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a95a418e-bc09-4318-a4ea-10403c41b4ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:21:59.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d33cdfb-caa4-4c56-93af-13a49f9f4b81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:21:59.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d33cdfb-caa4-4c56-93af-13a49f9f4b81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68331fdb 2021-04-14T11:21:59.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d33cdfb-caa4-4c56-93af-13a49f9f4b81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:21:59.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d33cdfb-caa4-4c56-93af-13a49f9f4b81 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:00.418Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:00.418Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:00.418Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:00.418Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:00.539Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Nfppositionelement 2021-04-14T11:22:00.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4858ab00-6904-4ec6-9aa5-2e134221aabd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:00.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4858ab00-6904-4ec6-9aa5-2e134221aabd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f9450d 2021-04-14T11:22:00.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4858ab00-6904-4ec6-9aa5-2e134221aabd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:00.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4858ab00-6904-4ec6-9aa5-2e134221aabd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:01.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=727eb1dd-9cff-446f-b2f9-eee6c18022bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:01.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=727eb1dd-9cff-446f-b2f9-eee6c18022bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4769b6a 2021-04-14T11:22:01.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=727eb1dd-9cff-446f-b2f9-eee6c18022bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:01.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=727eb1dd-9cff-446f-b2f9-eee6c18022bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:02.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:02.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@681cd33f 2021-04-14T11:22:02.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:02.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:02.638Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NfpPositionElement" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7998df1d-c7d1-47c4-8545-9125e685dd7a EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:22:02.640Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NfpPositionElement" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7998df1d-c7d1-47c4-8545-9125e685dd7a TargetServiceName=null EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:22:04.240Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NfpPositionElement" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7998df1d-c7d1-47c4-8545-9125e685dd7a TargetServiceName=null EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 ErrorCode=500 lock resource with id 2057a2bf-5241-4704-b6df-eee2c022f39b 2021-04-14T11:22:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:22:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:22:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:22:04.599Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:22:04.600Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:22:04.600Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:22:05.544Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:22:05.544Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:22:05.544Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:05.545Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=248c0bc9-405d-4916-b77b-e7f5b8eccbe8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:06.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806ba1df-fb39-4717-ba2e-006d2ba727a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:06.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806ba1df-fb39-4717-ba2e-006d2ba727a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1821d420 2021-04-14T11:22:06.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806ba1df-fb39-4717-ba2e-006d2ba727a8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:06.388Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806ba1df-fb39-4717-ba2e-006d2ba727a8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:07.727Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate" CURR_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfppositionelement-template.yml,0,2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4522b16e-3a2d-49b1-a612-ea7d0c098523 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 ErrorCode=500 Starting to create Csar for component NfpPositionElement 2021-04-14T11:22:07.925Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate" CURR_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfppositionelement-template.yml,0,2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4522b16e-3a2d-49b1-a612-ea7d0c098523 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 ErrorCode=500 Ended create Csar for component NfpPositionElement 2021-04-14T11:22:07.926Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate" CURR_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfppositionelement-template.yml,0,2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=4522b16e-3a2d-49b1-a612-ea7d0c098523 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 ErrorCode=500 lock resource with id 2057a2bf-5241-4704-b6df-eee2c022f39b 2021-04-14T11:22:09.558Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=806ba1df-fb39-4717-ba2e-006d2ba727a8 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:09.559Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=806ba1df-fb39-4717-ba2e-006d2ba727a8 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:10.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ae0984-eb24-44b5-bf2f-e395e030097d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:10.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ae0984-eb24-44b5-bf2f-e395e030097d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63a647d2 2021-04-14T11:22:10.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ae0984-eb24-44b5-bf2f-e395e030097d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:10.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ae0984-eb24-44b5-bf2f-e395e030097d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:10.454Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPositionElement" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "7998df1d-c7d1-47c4-8545-9125e685dd7a" INVARIANT_UUID = "c9957e2b-8c40-4bb1-a1e7-02c15e14514d" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscacsar" CURR_ARTIFACT_UUID = "2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Nfppositionelement-csar.csar,0,2057a2bf-5241-4704-b6df-eee2c022f39b.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=12357 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=87ecd951-f65f-478d-8a9c-eae73ada34d5 TargetServiceName=null EntryTimestamp=2021-04-14T11:21:58.097Z InvocationID=0324bd3a-48da-4d37-aa75-099cddf02101 ErrorCode=500 LogTimestamp=2021-04-14T11:22:10.454034Z ResponseDesc=Created Exiting. 2021-04-14T11:22:10.455Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:22:10.521Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e11b68b3-b41e-4c6e-a718-6d9cdfe03cb6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:10.520949Z InvocationID=6cf5e400-a021-48c7-9bf1-9833ab23eab1 LogTimestamp=2021-04-14T11:22:10.521018Z Entering 2021-04-14T11:22:10.521Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e11b68b3-b41e-4c6e-a718-6d9cdfe03cb6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:10.520949Z InvocationID=6cf5e400-a021-48c7-9bf1-9833ab23eab1 LogTimestamp=2021-04-14T11:22:10.521018Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:22:11.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa5e0960-837e-4568-9e91-9ed8b43ae032 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:11.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa5e0960-837e-4568-9e91-9ed8b43ae032 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dade5b2 2021-04-14T11:22:11.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa5e0960-837e-4568-9e91-9ed8b43ae032 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:11.428Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa5e0960-837e-4568-9e91-9ed8b43ae032 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:12.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9334de5-fcff-49c9-a7a2-e3492f6684f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:12.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9334de5-fcff-49c9-a7a2-e3492f6684f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bbbacf3 2021-04-14T11:22:12.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9334de5-fcff-49c9-a7a2-e3492f6684f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:12.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9334de5-fcff-49c9-a7a2-e3492f6684f9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:12.936Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:12.936Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:12.936Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:12.936Z [qtp580718781-13] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:12.936Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Nfpposition 2021-04-14T11:22:14.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb86b328-4c48-493b-9e2c-89e12a943fe1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:14.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb86b328-4c48-493b-9e2c-89e12a943fe1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71d2db9b 2021-04-14T11:22:14.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb86b328-4c48-493b-9e2c-89e12a943fe1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:14.572Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb86b328-4c48-493b-9e2c-89e12a943fe1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:16.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f804af0-1f11-4439-8df7-a0e192ae1f77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:16.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f804af0-1f11-4439-8df7-a0e192ae1f77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@201b9aa4 2021-04-14T11:22:16.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f804af0-1f11-4439-8df7-a0e192ae1f77 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:16.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f804af0-1f11-4439-8df7-a0e192ae1f77 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:17.191Z [qtp580718781-13] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NfpPosition" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=971d6a3e-8239-4c04-aaa4-5d75ae45c4d4 EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:22:17.192Z [qtp580718781-13] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NfpPosition" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=971d6a3e-8239-4c04-aaa4-5d75ae45c4d4 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:22:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22196b60 2021-04-14T11:22:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:19.231Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NfpPosition" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=971d6a3e-8239-4c04-aaa4-5d75ae45c4d4 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 ErrorCode=500 lock resource with id 454aee25-cc3d-443c-8c52-5bb819c1397a 2021-04-14T11:22:20.963Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate" CURR_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfpposition-template.yml,0,454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=47e977e7-631e-4d8b-bafe-d434bc85cced TargetServiceName=null EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 ErrorCode=500 Starting to create Csar for component NfpPosition 2021-04-14T11:22:21.099Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:22:21.099Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:22:21.099Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:21.099Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8d174eac-eee8-4480-a2e5-eb7df22c4890 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:21.158Z [qtp580718781-13] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate" CURR_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfpposition-template.yml,0,454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=47e977e7-631e-4d8b-bafe-d434bc85cced TargetServiceName=null EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 ErrorCode=500 Ended create Csar for component NfpPosition 2021-04-14T11:22:21.159Z [qtp580718781-13] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate" CURR_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfpposition-template.yml,0,454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=47e977e7-631e-4d8b-bafe-d434bc85cced TargetServiceName=null EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 ErrorCode=500 lock resource with id 454aee25-cc3d-443c-8c52-5bb819c1397a 2021-04-14T11:22:21.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a528294-f252-4a30-aba3-95cafdeb1e63 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:21.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a528294-f252-4a30-aba3-95cafdeb1e63 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46397e4 2021-04-14T11:22:21.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a528294-f252-4a30-aba3-95cafdeb1e63 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:21.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a528294-f252-4a30-aba3-95cafdeb1e63 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:23.325Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NfpPosition" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "971d6a3e-8239-4c04-aaa4-5d75ae45c4d4" INVARIANT_UUID = "336734c6-4924-4867-9352-03292d1a30d7" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscacsar" CURR_ARTIFACT_UUID = "454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Nfpposition-csar.csar,0,454aee25-cc3d-443c-8c52-5bb819c1397a.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=12803 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cd4c293c-a5d8-49ed-9646-0bd815f1fc0a TargetServiceName=null EntryTimestamp=2021-04-14T11:22:10.521Z InvocationID=7a49c2e3-ae78-41df-b7db-3297cc4d9a37 ErrorCode=500 LogTimestamp=2021-04-14T11:22:23.324955Z ResponseDesc=Created Exiting. 2021-04-14T11:22:23.325Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:22:23.439Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ca54a4c0-6784-4a38-a382-c245f1970a23 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:23.439103Z InvocationID=b5d6502d-c6b9-4f69-8a55-ebf2413e395f LogTimestamp=2021-04-14T11:22:23.439169Z Entering 2021-04-14T11:22:23.439Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ca54a4c0-6784-4a38-a382-c245f1970a23 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:23.439103Z InvocationID=b5d6502d-c6b9-4f69-8a55-ebf2413e395f LogTimestamp=2021-04-14T11:22:23.439169Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:22:24.653Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:24.653Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:24.654Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:24.654Z [qtp580718781-14] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:24.714Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Nfp 2021-04-14T11:22:24.757Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2a528294-f252-4a30-aba3-95cafdeb1e63 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:22:24.757Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2a528294-f252-4a30-aba3-95cafdeb1e63 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:22:25.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fd7823-86cb-44b7-9be7-5bf9125cad0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:25.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fd7823-86cb-44b7-9be7-5bf9125cad0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fb8f29f 2021-04-14T11:22:25.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fd7823-86cb-44b7-9be7-5bf9125cad0c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:25.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fd7823-86cb-44b7-9be7-5bf9125cad0c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:28.426Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=17fd7823-86cb-44b7-9be7-5bf9125cad0c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:22:28.426Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=17fd7823-86cb-44b7-9be7-5bf9125cad0c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:22:29.038Z [qtp580718781-14] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NFP" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a52c73f8-9510-4d2b-9b59-8ec16cbc776d EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:22:29.039Z [qtp580718781-14] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NFP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a52c73f8-9510-4d2b-9b59-8ec16cbc776d TargetServiceName=null EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:22:29.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b86fc2b-9d27-4425-9d07-d56d8a64d3b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:29.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b86fc2b-9d27-4425-9d07-d56d8a64d3b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e57bde2 2021-04-14T11:22:29.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b86fc2b-9d27-4425-9d07-d56d8a64d3b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:29.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b86fc2b-9d27-4425-9d07-d56d8a64d3b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:31.337Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NFP" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=a52c73f8-9510-4d2b-9b59-8ec16cbc776d TargetServiceName=null EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a ErrorCode=500 lock resource with id a522e4e7-8daf-486f-81f2-bd2443c1b8e0 2021-04-14T11:22:31.831Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0b86fc2b-9d27-4425-9d07-d56d8a64d3b9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:31.832Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0b86fc2b-9d27-4425-9d07-d56d8a64d3b9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:32.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab01783e-9187-4389-b607-141b5de09837 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:32.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab01783e-9187-4389-b607-141b5de09837 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@149ca60 2021-04-14T11:22:32.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab01783e-9187-4389-b607-141b5de09837 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:32.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab01783e-9187-4389-b607-141b5de09837 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:33.916Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate" CURR_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfp-template.yml,0,a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7d128663-a239-4eb1-8d4c-c28274d8e351 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a ErrorCode=500 Starting to create Csar for component NFP 2021-04-14T11:22:34.133Z [qtp580718781-14] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate" CURR_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfp-template.yml,0,a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7d128663-a239-4eb1-8d4c-c28274d8e351 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a ErrorCode=500 Ended create Csar for component NFP 2021-04-14T11:22:34.134Z [qtp580718781-14] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate" CURR_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Nfp-template.yml,0,a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7d128663-a239-4eb1-8d4c-c28274d8e351 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a ErrorCode=500 lock resource with id a522e4e7-8daf-486f-81f2-bd2443c1b8e0 2021-04-14T11:22:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7095731a-5fb6-484c-aeab-02d1f78b225d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7095731a-5fb6-484c-aeab-02d1f78b225d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69f15aea 2021-04-14T11:22:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7095731a-5fb6-484c-aeab-02d1f78b225d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:34.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7095731a-5fb6-484c-aeab-02d1f78b225d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:36.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae97a78-b003-4d9b-862a-99b704b2f73a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:36.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae97a78-b003-4d9b-862a-99b704b2f73a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a9a529b 2021-04-14T11:22:36.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae97a78-b003-4d9b-862a-99b704b2f73a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:36.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fae97a78-b003-4d9b-862a-99b704b2f73a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:36.795Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NFP" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "a52c73f8-9510-4d2b-9b59-8ec16cbc776d" INVARIANT_UUID = "d8ceff1b-9b7f-4dad-a816-a0dcee764e55" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscacsar" CURR_ARTIFACT_UUID = "a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Nfp-csar.csar,0,a522e4e7-8daf-486f-81f2-bd2443c1b8e0.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13355 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3aae99b0-9bb4-4e8a-99cf-1c0d9aa73e9d TargetServiceName=null EntryTimestamp=2021-04-14T11:22:23.439Z InvocationID=37554d5c-aff3-4bc4-8f33-b6a42539508a ErrorCode=500 LogTimestamp=2021-04-14T11:22:36.794488Z ResponseDesc=Created Exiting. 2021-04-14T11:22:36.796Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:22:36.831Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a6fea420-6aec-4d98-8c2e-e98e52080522 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:36.831516Z InvocationID=7fcce8da-761f-4be8-867d-d1c93d3aeec8 LogTimestamp=2021-04-14T11:22:36.831556Z Entering 2021-04-14T11:22:36.832Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a6fea420-6aec-4d98-8c2e-e98e52080522 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:36.831516Z InvocationID=7fcce8da-761f-4be8-867d-d1c93d3aeec8 LogTimestamp=2021-04-14T11:22:36.831556Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:22:38.738Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:38.738Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:38.738Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:38.738Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:22:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3481c1d-c814-4486-9e37-888e2c806ac8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3481c1d-c814-4486-9e37-888e2c806ac8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cafb1ed 2021-04-14T11:22:39.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3481c1d-c814-4486-9e37-888e2c806ac8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:39.198Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3481c1d-c814-4486-9e37-888e2c806ac8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:39.233Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name Forwarding 2021-04-14T11:22:41.370Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Forwarding" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c07201fe-0a92-44ff-a2c2-3fc5fde31524 EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:22:41.370Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Forwarding" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c07201fe-0a92-44ff-a2c2-3fc5fde31524 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:22:41.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:41.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43fa60d2 2021-04-14T11:22:41.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:41.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:42.237Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Forwarding" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=c07201fe-0a92-44ff-a2c2-3fc5fde31524 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 ErrorCode=500 lock resource with id ad8bca3f-5943-4bfd-9eaf-4983464c8156 2021-04-14T11:22:44.339Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate" CURR_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Forwarding-template.yml,0,ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bb563399-23f4-4480-ba31-ef45906fa602 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 ErrorCode=500 Starting to create Csar for component Forwarding 2021-04-14T11:22:44.627Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate" CURR_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Forwarding-template.yml,0,ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bb563399-23f4-4480-ba31-ef45906fa602 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 ErrorCode=500 Ended create Csar for component Forwarding 2021-04-14T11:22:44.627Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate" CURR_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Forwarding-template.yml,0,ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=bb563399-23f4-4480-ba31-ef45906fa602 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 ErrorCode=500 lock resource with id ad8bca3f-5943-4bfd-9eaf-4983464c8156 2021-04-14T11:22:44.851Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:22:44.852Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:22:44.852Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:44.852Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b34ecace-13e7-402d-a345-35c8bc092ddc ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:22:45.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=793073c3-57af-4d6b-a863-5b39daa81c5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:45.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=793073c3-57af-4d6b-a863-5b39daa81c5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20bf444d 2021-04-14T11:22:45.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=793073c3-57af-4d6b-a863-5b39daa81c5b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:45.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=793073c3-57af-4d6b-a863-5b39daa81c5b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:47.190Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Forwarding" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "c07201fe-0a92-44ff-a2c2-3fc5fde31524" INVARIANT_UUID = "977f77f4-17d8-4c29-9d3b-acaf06420e04" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscacsar" CURR_ARTIFACT_UUID = "ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Forwarding-csar.csar,0,ad8bca3f-5943-4bfd-9eaf-4983464c8156.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=10358 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7afd4c4f-7fea-4721-bd6b-0615073cc557 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:36.832Z InvocationID=07b2a724-4cd7-41c2-97fa-dc2e7a9823e0 ErrorCode=500 LogTimestamp=2021-04-14T11:22:47.190056Z ResponseDesc=Created Exiting. 2021-04-14T11:22:47.190Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:22:47.234Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5fafcc18-13da-4f30-b03f-c440d196728f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:47.234533Z InvocationID=1b3e140c-8e7d-4382-bde1-9977e642b178 LogTimestamp=2021-04-14T11:22:47.234599Z Entering 2021-04-14T11:22:47.234Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5fafcc18-13da-4f30-b03f-c440d196728f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:22:47.234533Z InvocationID=1b3e140c-8e7d-4382-bde1-9977e642b178 LogTimestamp=2021-04-14T11:22:47.234599Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:22:48.537Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=793073c3-57af-4d6b-a863-5b39daa81c5b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:22:48.537Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=793073c3-57af-4d6b-a863-5b39daa81c5b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:22:49.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4462773-57c8-4c62-a6d7-f8be671d5a0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:49.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4462773-57c8-4c62-a6d7-f8be671d5a0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39082474 2021-04-14T11:22:49.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4462773-57c8-4c62-a6d7-f8be671d5a0a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:49.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4462773-57c8-4c62-a6d7-f8be671d5a0a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:49.631Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 21adce5b-57a4-4536-b9d9-507dd806cf59 2021-04-14T11:22:50.841Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource 21adce5b-57a4-4536-b9d9-507dd806cf59 is jh0003 2021-04-14T11:22:51.332Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "bddde228-dc37-4f0f-a983-597ee1e2e25b" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:22:51.332Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "bddde228-dc37-4f0f-a983-597ee1e2e25b" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:22:52.092Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f4462773-57c8-4c62-a6d7-f8be671d5a0a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:22:52.092Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f4462773-57c8-4c62-a6d7-f8be671d5a0a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:22:52.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eb80cc7-81fe-45e2-8eee-c2bdd4bf8426 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:52.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eb80cc7-81fe-45e2-8eee-c2bdd4bf8426 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73238b3a 2021-04-14T11:22:52.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eb80cc7-81fe-45e2-8eee-c2bdd4bf8426 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:52.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5eb80cc7-81fe-45e2-8eee-c2bdd4bf8426 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:53.930Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "bddde228-dc37-4f0f-a983-597ee1e2e25b" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:22:53.931Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "bddde228-dc37-4f0f-a983-597ee1e2e25b" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:22:55.832Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5eb80cc7-81fe-45e2-8eee-c2bdd4bf8426 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:22:55.832Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5eb80cc7-81fe-45e2-8eee-c2bdd4bf8426 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:22:56.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca196bae-1976-4c5b-992e-257e85117c08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:56.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca196bae-1976-4c5b-992e-257e85117c08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d8dc3d2 2021-04-14T11:22:56.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca196bae-1976-4c5b-992e-257e85117c08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:56.502Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca196bae-1976-4c5b-992e-257e85117c08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:22:56.896Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "bddde228-dc37-4f0f-a983-597ee1e2e25b" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 lock resource with id 98476da2-1b9d-493a-b3b3-e16fe666baa2 2021-04-14T11:22:57.582Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "bddde228-dc37-4f0f-a983-597ee1e2e25b" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.Compute" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 owner of resource 98476da2-1b9d-493a-b3b3-e16fe666baa2 is jh0003 2021-04-14T11:22:59.379Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 owner of resource 98476da2-1b9d-493a-b3b3-e16fe666baa2 is jh0003 2021-04-14T11:22:59.379Z [qtp580718781-18] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 validate before certification change. resource name=VDU Compute, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:22:59.380Z [qtp580718781-18] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f256c76d-2bb2-4c43-b400-1d13b7aa56c7 TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 start performing certification change for resource 98476da2-1b9d-493a-b3b3-e16fe666baa2 2021-04-14T11:22:59.512Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ca196bae-1976-4c5b-992e-257e85117c08 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:22:59.513Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ca196bae-1976-4c5b-992e-257e85117c08 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:22:59.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c774e4-abc2-4574-ac7b-88f2647d46ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:22:59.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c774e4-abc2-4574-ac7b-88f2647d46ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a8ffb51 2021-04-14T11:22:59.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c774e4-abc2-4574-ac7b-88f2647d46ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:22:59.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c774e4-abc2-4574-ac7b-88f2647d46ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:00.058Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" CURR_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCompute-template.yml,0,21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate,1,88d62477-8fe4-4299-aff5-2bb4152295c8" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e5bc8bf2-67de-4217-9558-db886297c57a TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 Starting to create Csar for component VDU Compute 2021-04-14T11:23:00.250Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" CURR_ARTIFACT_UUID = "21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCompute-template.yml,0,21adce5b-57a4-4536-b9d9-507dd806cf59.assettoscatemplate,1,88d62477-8fe4-4299-aff5-2bb4152295c8" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=e5bc8bf2-67de-4217-9558-db886297c57a TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 Ended create Csar for component VDU Compute 2021-04-14T11:23:01.310Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=525ffab4-fa22-42f9-9cb1-cd1fffd135cd TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:01.311Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=525ffab4-fa22-42f9-9cb1-cd1fffd135cd TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:01.311Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=525ffab4-fa22-42f9-9cb1-cd1fffd135cd TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 unlock component 98476da2-1b9d-493a-b3b3-e16fe666baa2 2021-04-14T11:23:01.311Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=525ffab4-fa22-42f9-9cb1-cd1fffd135cd TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 During change state, another component 98476da2-1b9d-493a-b3b3-e16fe666baa2 has been created/updated 2021-04-14T11:23:01.892Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Compute" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f256c76d-2bb2-4c43-b400-1d13b7aa56c7" INVARIANT_UUID = "feeef835-5714-4627-a794-6597fdb15a50" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=14656 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=525ffab4-fa22-42f9-9cb1-cd1fffd135cd TargetServiceName=null EntryTimestamp=2021-04-14T11:22:47.235Z InvocationID=4ccec98e-7e59-4905-bedd-7ad70198f27c ErrorCode=500 LogTimestamp=2021-04-14T11:23:01.891719Z ResponseDesc=Created Exiting. 2021-04-14T11:23:01.892Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:23:01.906Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ae231a13-79d0-47df-8bae-51c72e23ab01 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:01.906457Z InvocationID=a3b0d0dc-d1ef-4987-b00b-5c020a97597f LogTimestamp=2021-04-14T11:23:01.906509Z Entering 2021-04-14T11:23:01.906Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ae231a13-79d0-47df-8bae-51c72e23ab01 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:01.906457Z InvocationID=a3b0d0dc-d1ef-4987-b00b-5c020a97597f LogTimestamp=2021-04-14T11:23:01.906509Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:23:02.144Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073 2021-04-14T11:23:02.792Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c0c774e4-abc2-4574-ac7b-88f2647d46ae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:23:02.792Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c0c774e4-abc2-4574-ac7b-88f2647d46ae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:23:03.225Z [qtp580718781-12] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource 1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073 is jh0003 2021-04-14T11:23:03.434Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "57493b9e-2022-4388-b8eb-da8a27a1d83b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:03.434Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "57493b9e-2022-4388-b8eb-da8a27a1d83b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:03.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=552ccb13-ec09-4802-8894-09ea3ba5c7b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:03.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=552ccb13-ec09-4802-8894-09ea3ba5c7b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fb3cbba 2021-04-14T11:23:03.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=552ccb13-ec09-4802-8894-09ea3ba5c7b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:03.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=552ccb13-ec09-4802-8894-09ea3ba5c7b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:23:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:23:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:23:04.381Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:23:04.381Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:23:04.381Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:23:04.635Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "57493b9e-2022-4388-b8eb-da8a27a1d83b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:04.636Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "57493b9e-2022-4388-b8eb-da8a27a1d83b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:08.383Z [qtp580718781-12] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "57493b9e-2022-4388-b8eb-da8a27a1d83b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualFileStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 lock resource with id 25fd0fb5-7fd3-45dd-ad71-6668e9c23837 2021-04-14T11:23:08.606Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=552ccb13-ec09-4802-8894-09ea3ba5c7b6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:23:08.606Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=552ccb13-ec09-4802-8894-09ea3ba5c7b6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:23:09.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=537b49a9-8809-4e27-a8f5-6230608f603c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:09.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=537b49a9-8809-4e27-a8f5-6230608f603c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@496e7b2a 2021-04-14T11:23:09.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=537b49a9-8809-4e27-a8f5-6230608f603c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:09.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=537b49a9-8809-4e27-a8f5-6230608f603c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:09.537Z [qtp580718781-12] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "57493b9e-2022-4388-b8eb-da8a27a1d83b" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualFileStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 owner of resource 25fd0fb5-7fd3-45dd-ad71-6668e9c23837 is jh0003 2021-04-14T11:23:12.816Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=537b49a9-8809-4e27-a8f5-6230608f603c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:23:12.816Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=537b49a9-8809-4e27-a8f5-6230608f603c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:23:12.915Z [qtp580718781-12] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 owner of resource 25fd0fb5-7fd3-45dd-ad71-6668e9c23837 is jh0003 2021-04-14T11:23:12.915Z [qtp580718781-12] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 validate before certification change. resource name=VDU VirtualFileStorage, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:23:12.915Z [qtp580718781-12] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f75e5730-e9e2-43b6-892a-2770baefaa24 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 start performing certification change for resource 25fd0fb5-7fd3-45dd-ad71-6668e9c23837 2021-04-14T11:23:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2aed44-6709-4d79-892d-162fc23e0bd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2aed44-6709-4d79-892d-162fc23e0bd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c93e836 2021-04-14T11:23:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2aed44-6709-4d79-892d-162fc23e0bd0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:13.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2aed44-6709-4d79-892d-162fc23e0bd0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:15.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=169d90ed-45f0-4c91-8a62-6f17ce0bd25b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:15.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=169d90ed-45f0-4c91-8a62-6f17ce0bd25b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a74987 2021-04-14T11:23:15.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=169d90ed-45f0-4c91-8a62-6f17ce0bd25b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:15.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=169d90ed-45f0-4c91-8a62-6f17ce0bd25b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:16.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9659da73-ec6f-4f20-8a93-abc74062f301 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:16.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9659da73-ec6f-4f20-8a93-abc74062f301 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38aad5d2 2021-04-14T11:23:16.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9659da73-ec6f-4f20-8a93-abc74062f301 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:16.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9659da73-ec6f-4f20-8a93-abc74062f301 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:16.887Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" CURR_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualfilestorage-template.yml,0,1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate,1,0bd76be3-4092-4a75-bbc4-a39ca084e580" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=83858b4c-30c4-420b-ac22-14146c1afcb9 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 Starting to create Csar for component VDU VirtualFileStorage 2021-04-14T11:23:17.120Z [qtp580718781-12] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" CURR_ARTIFACT_UUID = "1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualfilestorage-template.yml,0,1ca8ce8d-c51c-4a4c-95b1-fddf87ca0073.assettoscatemplate,1,0bd76be3-4092-4a75-bbc4-a39ca084e580" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=83858b4c-30c4-420b-ac22-14146c1afcb9 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 Ended create Csar for component VDU VirtualFileStorage 2021-04-14T11:23:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3440cd12-f307-4d96-adc9-e1dfd6d015a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3440cd12-f307-4d96-adc9-e1dfd6d015a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@654ab537 2021-04-14T11:23:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3440cd12-f307-4d96-adc9-e1dfd6d015a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3440cd12-f307-4d96-adc9-e1dfd6d015a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:18.499Z [qtp580718781-12] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=06157cf7-07c5-4d97-a61b-0b461819b6f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:18.501Z [qtp580718781-12] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=06157cf7-07c5-4d97-a61b-0b461819b6f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:18.502Z [qtp580718781-12] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=06157cf7-07c5-4d97-a61b-0b461819b6f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 unlock component 25fd0fb5-7fd3-45dd-ad71-6668e9c23837 2021-04-14T11:23:18.502Z [qtp580718781-12] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=06157cf7-07c5-4d97-a61b-0b461819b6f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 During change state, another component 25fd0fb5-7fd3-45dd-ad71-6668e9c23837 has been created/updated 2021-04-14T11:23:18.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b4a6f30-edd2-41d4-a734-2e99bb95d955 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:18.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b4a6f30-edd2-41d4-a734-2e99bb95d955 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@562b23f0 2021-04-14T11:23:18.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b4a6f30-edd2-41d4-a734-2e99bb95d955 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:18.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b4a6f30-edd2-41d4-a734-2e99bb95d955 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:19.201Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualFileStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f75e5730-e9e2-43b6-892a-2770baefaa24" INVARIANT_UUID = "ebfa9e61-09e4-452f-a3e5-8d8155a7b6ef" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=17294 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=06157cf7-07c5-4d97-a61b-0b461819b6f5 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:01.907Z InvocationID=78d9dfd5-a1e9-4033-b770-740f7fffd2f6 ErrorCode=500 LogTimestamp=2021-04-14T11:23:19.201396Z ResponseDesc=Created Exiting. 2021-04-14T11:23:19.202Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:23:19.227Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=582294c4-713f-4624-b98a-7042e79ee18a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:19.227574Z InvocationID=5326ae17-29e2-49e1-a279-49572bdf7bcd LogTimestamp=2021-04-14T11:23:19.227628Z Entering 2021-04-14T11:23:19.228Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=582294c4-713f-4624-b98a-7042e79ee18a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:19.227574Z InvocationID=5326ae17-29e2-49e1-a279-49572bdf7bcd LogTimestamp=2021-04-14T11:23:19.227628Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:23:19.913Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id cb33efd8-ad02-4add-87f8-f92e9e664635 2021-04-14T11:23:20.623Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d9fb80-605e-4cae-80dc-119644522488 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:20.623Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d9fb80-605e-4cae-80dc-119644522488 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ef8b3c3 2021-04-14T11:23:20.623Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d9fb80-605e-4cae-80dc-119644522488 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:20.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56d9fb80-605e-4cae-80dc-119644522488 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:20.667Z [qtp580718781-11] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource cb33efd8-ad02-4add-87f8-f92e9e664635 is jh0003 2021-04-14T11:23:20.767Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "571542b5-61c9-47ca-981d-fa728d89aeef" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:20.769Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "571542b5-61c9-47ca-981d-fa728d89aeef" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:21.148Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "571542b5-61c9-47ca-981d-fa728d89aeef" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:21.149Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "571542b5-61c9-47ca-981d-fa728d89aeef" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:21.910Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "571542b5-61c9-47ca-981d-fa728d89aeef" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfExtCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 lock resource with id 7ccf4ce8-d97c-4d0d-8416-6d6aa43904da 2021-04-14T11:23:22.445Z [qtp580718781-11] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "571542b5-61c9-47ca-981d-fa728d89aeef" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VnfExtCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 owner of resource 7ccf4ce8-d97c-4d0d-8416-6d6aa43904da is jh0003 2021-04-14T11:23:24.228Z [qtp580718781-11] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 owner of resource 7ccf4ce8-d97c-4d0d-8416-6d6aa43904da is jh0003 2021-04-14T11:23:24.229Z [qtp580718781-11] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 validate before certification change. resource name=VNF External CP, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:23:24.229Z [qtp580718781-11] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 start performing certification change for resource 7ccf4ce8-d97c-4d0d-8416-6d6aa43904da 2021-04-14T11:23:24.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00c5fbe-9ba2-4f0a-a046-95103df05f13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:24.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00c5fbe-9ba2-4f0a-a046-95103df05f13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12ff8b 2021-04-14T11:23:24.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00c5fbe-9ba2-4f0a-a046-95103df05f13 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:24.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a00c5fbe-9ba2-4f0a-a046-95103df05f13 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=824290e4-5974-4a13-ba8d-635abd698b43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=824290e4-5974-4a13-ba8d-635abd698b43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@304101b3 2021-04-14T11:23:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=824290e4-5974-4a13-ba8d-635abd698b43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=824290e4-5974-4a13-ba8d-635abd698b43 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:28.645Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VnfExternalCp-template.yml,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate,1,85b39a08-863c-4d6b-867f-578e1258697c" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a7fba2e-c617-497d-851f-e07e82d461f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 Starting to create Csar for component VNF External CP 2021-04-14T11:23:28.893Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VnfExternalCp-template.yml,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscatemplate,1,85b39a08-863c-4d6b-867f-578e1258697c" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a7fba2e-c617-497d-851f-e07e82d461f3 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 Ended create Csar for component VNF External CP 2021-04-14T11:23:30.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69b1343-b75d-4ac3-970d-c00c75962284 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:30.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69b1343-b75d-4ac3-970d-c00c75962284 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f7a90e8 2021-04-14T11:23:30.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69b1343-b75d-4ac3-970d-c00c75962284 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:30.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c69b1343-b75d-4ac3-970d-c00c75962284 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:33.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469514a6-5e32-4f0d-a663-99719f15be07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:33.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469514a6-5e32-4f0d-a663-99719f15be07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14b75a6f 2021-04-14T11:23:33.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469514a6-5e32-4f0d-a663-99719f15be07 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:33.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469514a6-5e32-4f0d-a663-99719f15be07 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:34.237Z [qtp580718781-11] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscacsar" CURR_ARTIFACT_UUID = "cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VnfExternalCp-csar.csar,0,cb33efd8-ad02-4add-87f8-f92e9e664635.assettoscacsar,1,2b688769-f098-4070-b42d-cefc6c385622" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cb13538-3322-44c3-bf6e-297ba4dba464 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.jsongraph.JanusGraphDao.commit(JanusGraphDao.java:65) at org.openecomp.sdc.be.components.lifecycle.CertificationChangeTransition.changeState(CertificationChangeTransition.java:181) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeState(LifecycleBusinessLogic.java:320) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeComponentState(LifecycleBusinessLogic.java:223) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeState(LifecycleBusinessLogic.java:144) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.nodeFullCertification(ResourceBusinessLogic.java:3869) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.propagateStateToCertified(ResourceBusinessLogic.java:3849) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:231) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:23:34.534Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cb13538-3322-44c3-bf6e-297ba4dba464 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:34.534Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cb13538-3322-44c3-bf6e-297ba4dba464 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:34.535Z [qtp580718781-11] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cb13538-3322-44c3-bf6e-297ba4dba464 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 unlock component 7ccf4ce8-d97c-4d0d-8416-6d6aa43904da 2021-04-14T11:23:34.535Z [qtp580718781-11] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cb13538-3322-44c3-bf6e-297ba4dba464 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 During change state, another component 7ccf4ce8-d97c-4d0d-8416-6d6aa43904da has been created/updated 2021-04-14T11:23:35.498Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF External CP" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "f48fe8a9-bc1b-46ca-adc3-bd5fab1a31da" INVARIANT_UUID = "38f16143-83f2-4258-abf9-7713dd01a4b0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=16269 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=9cb13538-3322-44c3-bf6e-297ba4dba464 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:19.228Z InvocationID=a63b3619-1425-4511-992d-bf58c17d30d5 ErrorCode=500 LogTimestamp=2021-04-14T11:23:35.497938Z ResponseDesc=Created Exiting. 2021-04-14T11:23:35.498Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:23:35.635Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6ce94b7a-2c4b-4890-b2e7-f302e07911b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:35.635702Z InvocationID=8875888f-50fa-4b73-8346-c73a9ca5c670 LogTimestamp=2021-04-14T11:23:35.635756Z Entering 2021-04-14T11:23:35.636Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6ce94b7a-2c4b-4890-b2e7-f302e07911b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:35.635702Z InvocationID=8875888f-50fa-4b73-8346-c73a9ca5c670 LogTimestamp=2021-04-14T11:23:35.635756Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:23:36.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b0b389-2b66-4a58-88ac-6dbac4555b19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:36.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b0b389-2b66-4a58-88ac-6dbac4555b19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34e01d5 2021-04-14T11:23:36.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b0b389-2b66-4a58-88ac-6dbac4555b19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:36.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8b0b389-2b66-4a58-88ac-6dbac4555b19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:37.648Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 2643c492-64fd-4595-b688-a6e2298f56b6 2021-04-14T11:23:39.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d823fc4-a38c-4fcf-bbe9-6e2249cec6ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:39.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d823fc4-a38c-4fcf-bbe9-6e2249cec6ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b3ac496 2021-04-14T11:23:39.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d823fc4-a38c-4fcf-bbe9-6e2249cec6ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:39.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d823fc4-a38c-4fcf-bbe9-6e2249cec6ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:39.589Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource 2643c492-64fd-4595-b688-a6e2298f56b6 is jh0003 2021-04-14T11:23:39.966Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:39.967Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:41.536Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:41.537Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:42.096Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2326ebab-fb64-477d-a5b7-2683eed71c55 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:42.096565Z InvocationID=bf14afe3-ea59-423c-a9a8-a032e4ea807c LogTimestamp=2021-04-14T11:23:42.096643Z Entering 2021-04-14T11:23:42.097Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2326ebab-fb64-477d-a5b7-2683eed71c55 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:42.096565Z InvocationID=bf14afe3-ea59-423c-a9a8-a032e4ea807c LogTimestamp=2021-04-14T11:23:42.096643Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:23:42.099Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:23:42.097Z InvocationID=dbd17bc7-5af5-4ca9-bf84-90e3a8518f49 LogTimestamp=2021-04-14T11:23:42.098969Z ResponseDesc=OK Exiting. 2021-04-14T11:23:42.099Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:23:42.333Z [qtp580718781-18] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 Lock write succeeded but took too long: duration PT0.781709S exceeded limit PT0.5S 2021-04-14T11:23:42.341Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103cbf9f-7bba-4f37-be22-1808404bbbcf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:42.341Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103cbf9f-7bba-4f37-be22-1808404bbbcf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@502cfec9 2021-04-14T11:23:42.341Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103cbf9f-7bba-4f37-be22-1808404bbbcf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:42.341Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103cbf9f-7bba-4f37-be22-1808404bbbcf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:44.316Z [qtp580718781-18] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 lock resource with id cedf4c84-6abf-4fbe-be91-837155c07101 2021-04-14T11:23:45.038Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "c77b15ff-bb64-448f-b0d8-0226c8c77b4c" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VduCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 owner of resource cedf4c84-6abf-4fbe-be91-837155c07101 is jh0003 2021-04-14T11:23:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1cb4fe-a874-4183-abef-0e94173b2e06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1cb4fe-a874-4183-abef-0e94173b2e06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e66b281 2021-04-14T11:23:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1cb4fe-a874-4183-abef-0e94173b2e06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:45.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf1cb4fe-a874-4183-abef-0e94173b2e06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58814fc-47dc-4ef6-b6e3-4322b5e721ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58814fc-47dc-4ef6-b6e3-4322b5e721ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dd55431 2021-04-14T11:23:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58814fc-47dc-4ef6-b6e3-4322b5e721ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58814fc-47dc-4ef6-b6e3-4322b5e721ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac0445-3f3d-45b5-8089-2ca1b191f05c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac0445-3f3d-45b5-8089-2ca1b191f05c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60a62f69 2021-04-14T11:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac0445-3f3d-45b5-8089-2ca1b191f05c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44ac0445-3f3d-45b5-8089-2ca1b191f05c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:51.739Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 owner of resource cedf4c84-6abf-4fbe-be91-837155c07101 is jh0003 2021-04-14T11:23:51.739Z [qtp580718781-18] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 validate before certification change. resource name=VDU Cp, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:23:51.739Z [qtp580718781-18] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0d7f0764-ff28-4815-8409-a730af5c4bad TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 start performing certification change for resource cedf4c84-6abf-4fbe-be91-837155c07101 2021-04-14T11:23:54.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c080617-e34c-41c4-a647-eb8c09e25297 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:54.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c080617-e34c-41c4-a647-eb8c09e25297 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@574b5f02 2021-04-14T11:23:54.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c080617-e34c-41c4-a647-eb8c09e25297 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:54.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c080617-e34c-41c4-a647-eb8c09e25297 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:55.252Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCp-template.yml,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate,1,a3d07cc3-d163-4b1b-a057-9645d5c83a1c" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a6a4677-6b69-42a4-a6ad-2ad76a27a557 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 Starting to create Csar for component VDU Cp 2021-04-14T11:23:55.470Z [qtp580718781-18] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" CURR_ARTIFACT_UUID = "2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduCp-template.yml,0,2643c492-64fd-4595-b688-a6e2298f56b6.assettoscatemplate,1,a3d07cc3-d163-4b1b-a057-9645d5c83a1c" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=0a6a4677-6b69-42a4-a6ad-2ad76a27a557 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 Ended create Csar for component VDU Cp 2021-04-14T11:23:57.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a71d97-5aef-46d4-8ec7-59d1f9962a66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:57.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a71d97-5aef-46d4-8ec7-59d1f9962a66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cf20dd0 2021-04-14T11:23:57.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a71d97-5aef-46d4-8ec7-59d1f9962a66 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:57.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87a71d97-5aef-46d4-8ec7-59d1f9962a66 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:59.266Z [qtp580718781-18] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=89c91e39-d32e-4a70-b90d-415192a18860 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:23:59.266Z [qtp580718781-18] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=89c91e39-d32e-4a70-b90d-415192a18860 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:23:59.266Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=89c91e39-d32e-4a70-b90d-415192a18860 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 unlock component cedf4c84-6abf-4fbe-be91-837155c07101 2021-04-14T11:23:59.266Z [qtp580718781-18] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=89c91e39-d32e-4a70-b90d-415192a18860 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 During change state, another component cedf4c84-6abf-4fbe-be91-837155c07101 has been created/updated 2021-04-14T11:23:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b139e9f-c486-4264-a02a-f52c88fe0ddd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:23:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b139e9f-c486-4264-a02a-f52c88fe0ddd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ba1b6a3 2021-04-14T11:23:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b139e9f-c486-4264-a02a-f52c88fe0ddd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:23:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b139e9f-c486-4264-a02a-f52c88fe0ddd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:23:59.889Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU Cp" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "0d7f0764-ff28-4815-8409-a730af5c4bad" INVARIANT_UUID = "5d6677b1-89d7-4a36-ac9c-67cf7d01bfd0" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=24252 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=89c91e39-d32e-4a70-b90d-415192a18860 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:35.636Z InvocationID=f5917f42-ddf2-4ed0-b786-9d89ea2f9060 ErrorCode=500 LogTimestamp=2021-04-14T11:23:59.888369Z ResponseDesc=Created Exiting. 2021-04-14T11:23:59.889Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:23:59.903Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=577efda7-b95d-411c-8991-5f4c0733e662 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:59.902735Z InvocationID=fcdb7b68-e0aa-4bd2-a19c-e5fd9a30b43d LogTimestamp=2021-04-14T11:23:59.902773Z Entering 2021-04-14T11:23:59.903Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=577efda7-b95d-411c-8991-5f4c0733e662 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:23:59.902735Z InvocationID=fcdb7b68-e0aa-4bd2-a19c-e5fd9a30b43d LogTimestamp=2021-04-14T11:23:59.902773Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:24:01.271Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:24:01.271Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:24:01.271Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:24:01.271Z [qtp580718781-17] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:24:01.303Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VipCp 2021-04-14T11:24:02.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1d59eda-c482-4d9b-8410-4de7abe966f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:02.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1d59eda-c482-4d9b-8410-4de7abe966f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6aad1bd9 2021-04-14T11:24:02.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1d59eda-c482-4d9b-8410-4de7abe966f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:02.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1d59eda-c482-4d9b-8410-4de7abe966f9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:24:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:24:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:24:05.157Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:24:05.157Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:24:05.157Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:24:05.340Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VipCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=48b7bc3a-fb5b-4523-bec5-47edc306510f EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:24:05.341Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VipCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=48b7bc3a-fb5b-4523-bec5-47edc306510f TargetServiceName=null EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:24:05.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea075993-6407-4ebe-9e9b-66be24bf9858 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:05.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea075993-6407-4ebe-9e9b-66be24bf9858 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6793eac1 2021-04-14T11:24:05.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea075993-6407-4ebe-9e9b-66be24bf9858 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:05.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea075993-6407-4ebe-9e9b-66be24bf9858 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:09.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358a37bc-be37-492a-8609-852af7662507 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:09.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358a37bc-be37-492a-8609-852af7662507 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b03e76e 2021-04-14T11:24:09.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358a37bc-be37-492a-8609-852af7662507 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:09.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=358a37bc-be37-492a-8609-852af7662507 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:10.434Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VipCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=48b7bc3a-fb5b-4523-bec5-47edc306510f TargetServiceName=null EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 ErrorCode=500 lock resource with id d696a26a-dc29-43a1-96d9-f10fd55df34c 2021-04-14T11:24:12.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75fbea7-deb0-40bc-8185-d99491ef584e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:12.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75fbea7-deb0-40bc-8185-d99491ef584e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5da14003 2021-04-14T11:24:12.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75fbea7-deb0-40bc-8185-d99491ef584e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:12.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c75fbea7-deb0-40bc-8185-d99491ef584e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:14.138Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate" CURR_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VipCp-template.yml,0,d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=29d40727-6e2c-4744-a7a6-713d9867f092 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 ErrorCode=500 Starting to create Csar for component VIP Cp 2021-04-14T11:24:14.721Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate" CURR_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VipCp-template.yml,0,d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=29d40727-6e2c-4744-a7a6-713d9867f092 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 ErrorCode=500 Ended create Csar for component VIP Cp 2021-04-14T11:24:14.722Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate" CURR_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VipCp-template.yml,0,d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=29d40727-6e2c-4744-a7a6-713d9867f092 TargetServiceName=null EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 ErrorCode=500 lock resource with id d696a26a-dc29-43a1-96d9-f10fd55df34c 2021-04-14T11:24:16.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018233e4-cbfb-4ea8-8447-7ef4bd450255 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:16.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018233e4-cbfb-4ea8-8447-7ef4bd450255 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fd0ebbd 2021-04-14T11:24:16.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018233e4-cbfb-4ea8-8447-7ef4bd450255 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:16.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018233e4-cbfb-4ea8-8447-7ef4bd450255 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:18.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7494db48-4aa5-4e49-831c-fb7e5ac51c00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:18.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7494db48-4aa5-4e49-831c-fb7e5ac51c00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@276dc764 2021-04-14T11:24:18.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7494db48-4aa5-4e49-831c-fb7e5ac51c00 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:18.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7494db48-4aa5-4e49-831c-fb7e5ac51c00 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:18.755Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VIP Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "48b7bc3a-fb5b-4523-bec5-47edc306510f" INVARIANT_UUID = "9fe2ffbe-ec03-44b6-9aae-f53f9a5cae90" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscacsar" CURR_ARTIFACT_UUID = "d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VipCp-csar.csar,0,d696a26a-dc29-43a1-96d9-f10fd55df34c.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=18852 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=3443b750-e7f6-4388-9096-c83802e8806f TargetServiceName=null EntryTimestamp=2021-04-14T11:23:59.903Z InvocationID=487ce22d-c135-4aa1-91ca-3187facf2650 ErrorCode=500 LogTimestamp=2021-04-14T11:24:18.755033Z ResponseDesc=Created Exiting. 2021-04-14T11:24:18.755Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:24:18.931Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9b1c84ce-540f-4d83-ad97-d7a6f89bf07a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:24:18.931053Z InvocationID=38238863-10ab-48b2-aa8e-47f83998562d LogTimestamp=2021-04-14T11:24:18.931092Z Entering 2021-04-14T11:24:18.931Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9b1c84ce-540f-4d83-ad97-d7a6f89bf07a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:24:18.931053Z InvocationID=38238863-10ab-48b2-aa8e-47f83998562d LogTimestamp=2021-04-14T11:24:18.931092Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:24:19.819Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id 893b16db-8e31-49c5-ac17-e9e74bf0903e 2021-04-14T11:24:21.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d3287ad-e270-42c2-a32a-19d46407a242 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:21.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d3287ad-e270-42c2-a32a-19d46407a242 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53a16c70 2021-04-14T11:24:21.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d3287ad-e270-42c2-a32a-19d46407a242 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:21.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d3287ad-e270-42c2-a32a-19d46407a242 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:21.737Z [qtp580718781-15] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource 893b16db-8e31-49c5-ac17-e9e74bf0903e is jh0003 2021-04-14T11:24:21.854Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:24:21.855Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:24:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4578f5f 2021-04-14T11:24:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:27.121Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:24:27.121Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:24:27.122Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:24:27.122Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ed1097ea-c3fe-403b-a1d8-8f439a9cc46f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:24:27.786Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:24:27.787Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:24:27.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b15d4ccb-415b-4dcc-b710-ac65c5b9d173 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:27.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b15d4ccb-415b-4dcc-b710-ac65c5b9d173 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c02116b 2021-04-14T11:24:27.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b15d4ccb-415b-4dcc-b710-ac65c5b9d173 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:27.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b15d4ccb-415b-4dcc-b710-ac65c5b9d173 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:30.852Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b15d4ccb-415b-4dcc-b710-ac65c5b9d173 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:24:30.853Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b15d4ccb-415b-4dcc-b710-ac65c5b9d173 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:24:34.351Z [qtp580718781-15] WARN o.j.d.l.c.ConsistentKeyLocker AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Temporary storage failure while checking locks org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.getSliceWithRetries(ConsistentKeyLocker.java:464) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:426) at org.janusgraph.diskstorage.locking.consistentkey.ConsistentKeyLocker.checkSingleLock(ConsistentKeyLocker.java:118) at org.janusgraph.diskstorage.locking.AbstractLocker.checkLocks(AbstractLocker.java:351) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.checkAllLocks(ExpectedValueCheckingTransaction.java:175) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingTransaction.prepareForMutations(ExpectedValueCheckingTransaction.java:154) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:72) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponent(GraphLockOperation.java:70) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.updateExistingResourceByImport(ResourceBusinessLogic.java:4080) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3910) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ALL (3 responses were required but only 2 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:24:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:24:36.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:24:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:24:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:24:42.993Z [cluster1-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:24:42.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ce9c0b3-8c46-46e1-acc0-25f0a6b72948 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:42.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ce9c0b3-8c46-46e1-acc0-25f0a6b72948 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d078757 2021-04-14T11:24:42.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ce9c0b3-8c46-46e1-acc0-25f0a6b72948 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:42.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ce9c0b3-8c46-46e1-acc0-25f0a6b72948 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:24:44.821Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:24:45.840Z [qtp580718781-15] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponent(GraphLockOperation.java:70) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.updateExistingResourceByImport(ResourceBusinessLogic.java:4080) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3910) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:24:46.005Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3ce9c0b3-8c46-46e1-acc0-25f0a6b72948 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:24:46.006Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3ce9c0b3-8c46-46e1-acc0-25f0a6b72948 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:24:46.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4375ed21-a823-4afd-b1f8-d03f207402f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:46.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4375ed21-a823-4afd-b1f8-d03f207402f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39d71a5f 2021-04-14T11:24:46.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4375ed21-a823-4afd-b1f8-d03f207402f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:46.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4375ed21-a823-4afd-b1f8-d03f207402f1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:24:49.511Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 lock resource with id f12b024e-0439-4b4c-8f24-d62ab05f6684 2021-04-14T11:24:49.519Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4375ed21-a823-4afd-b1f8-d03f207402f1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:24:49.519Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4375ed21-a823-4afd-b1f8-d03f207402f1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:24:50.135Z [qtp580718781-15] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "d9a1504c-8c06-4bdd-8967-07630a544910" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.VirtualBlockStorage" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 owner of resource f12b024e-0439-4b4c-8f24-d62ab05f6684 is jh0003 2021-04-14T11:24:50.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc061a-054e-4a61-9d62-57ea1b108e11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:50.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc061a-054e-4a61-9d62-57ea1b108e11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30a5aaa3 2021-04-14T11:24:50.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc061a-054e-4a61-9d62-57ea1b108e11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:50.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77cc061a-054e-4a61-9d62-57ea1b108e11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:52.356Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=77cc061a-054e-4a61-9d62-57ea1b108e11 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:24:52.356Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=77cc061a-054e-4a61-9d62-57ea1b108e11 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:24:54.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:54.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52f64997 2021-04-14T11:24:54.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:54.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:55.735Z [qtp580718781-15] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 owner of resource f12b024e-0439-4b4c-8f24-d62ab05f6684 is jh0003 2021-04-14T11:24:55.735Z [qtp580718781-15] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 validate before certification change. resource name=VDU VirtualBlockStorage, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:24:55.736Z [qtp580718781-15] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=573121c2-3563-457a-b058-4c2bf508510d TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 start performing certification change for resource f12b024e-0439-4b4c-8f24-d62ab05f6684 2021-04-14T11:24:57.245Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:24:57.246Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:24:57.246Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:24:57.246Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=04765902-bf4f-47ad-8941-6bf3fb6539d9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:24:57.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1019cce-8f4e-4ad3-918d-376d687a6a6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:24:57.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1019cce-8f4e-4ad3-918d-376d687a6a6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e94adbf 2021-04-14T11:24:57.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1019cce-8f4e-4ad3-918d-376d687a6a6b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:24:57.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1019cce-8f4e-4ad3-918d-376d687a6a6b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:24:58.938Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualblockstorage-template.yml,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate,1,6690c059-175e-4f57-8d30-6a068a65ab8e" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d0e5ed7a-345d-44f4-b533-c689330a1a23 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Starting to create Csar for component VDU VirtualBlockStorage 2021-04-14T11:24:59.748Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VduVirtualblockstorage-template.yml,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscatemplate,1,6690c059-175e-4f57-8d30-6a068a65ab8e" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d0e5ed7a-345d-44f4-b533-c689330a1a23 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Ended create Csar for component VDU VirtualBlockStorage 2021-04-14T11:25:00.866Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b1019cce-8f4e-4ad3-918d-376d687a6a6b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:00.866Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b1019cce-8f4e-4ad3-918d-376d687a6a6b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:01.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7d3cbe-f02d-476f-adcc-465171966432 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:01.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7d3cbe-f02d-476f-adcc-465171966432 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5efb843 2021-04-14T11:25:01.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7d3cbe-f02d-476f-adcc-465171966432 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:01.663Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb7d3cbe-f02d-476f-adcc-465171966432 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:25:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:25:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:25:04.546Z [qtp580718781-15] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscacsar" CURR_ARTIFACT_UUID = "893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VduVirtualblockstorage-csar.csar,0,893b16db-8e31-49c5-ac17-e9e74bf0903e.assettoscacsar,1,67f7b40c-3000-4946-bbf8-2ae135ce28fb" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b8e9212d-7426-4ce5-8ea2-d9c631d068d7 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.jsongraph.JanusGraphDao.commit(JanusGraphDao.java:65) at org.openecomp.sdc.be.components.lifecycle.CertificationChangeTransition.changeState(CertificationChangeTransition.java:181) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeState(LifecycleBusinessLogic.java:320) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeComponentState(LifecycleBusinessLogic.java:223) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeState(LifecycleBusinessLogic.java:144) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.nodeFullCertification(ResourceBusinessLogic.java:3869) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.propagateStateToCertified(ResourceBusinessLogic.java:3849) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:231) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:25:04.670Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fb7d3cbe-f02d-476f-adcc-465171966432 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:04.670Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fb7d3cbe-f02d-476f-adcc-465171966432 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:04.740Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b8e9212d-7426-4ce5-8ea2-d9c631d068d7 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:25:04.741Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b8e9212d-7426-4ce5-8ea2-d9c631d068d7 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:25:04.741Z [qtp580718781-15] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b8e9212d-7426-4ce5-8ea2-d9c631d068d7 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 unlock component f12b024e-0439-4b4c-8f24-d62ab05f6684 2021-04-14T11:25:04.741Z [qtp580718781-15] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b8e9212d-7426-4ce5-8ea2-d9c631d068d7 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 During change state, another component f12b024e-0439-4b4c-8f24-d62ab05f6684 has been created/updated 2021-04-14T11:25:05.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f595f-3582-4fde-b72c-e7db5a8666c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:05.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f595f-3582-4fde-b72c-e7db5a8666c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1eb753d4 2021-04-14T11:25:05.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f595f-3582-4fde-b72c-e7db5a8666c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:05.439Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f595f-3582-4fde-b72c-e7db5a8666c0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:05.698Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:25:05.698Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:25:05.715Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:25:05.715Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:25:05.733Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VDU VirtualBlockStorage" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "573121c2-3563-457a-b058-4c2bf508510d" INVARIANT_UUID = "9ccb5c35-1ca7-40a8-a4c9-2485da6a128c" PREV_VERSION = "1.1" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=46801 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=b8e9212d-7426-4ce5-8ea2-d9c631d068d7 TargetServiceName=null EntryTimestamp=2021-04-14T11:24:18.931Z InvocationID=60e8b7b7-3473-424b-b8a3-17d2b4d0647b ErrorCode=500 LogTimestamp=2021-04-14T11:25:05.732728Z ResponseDesc=Created Exiting. 2021-04-14T11:25:05.734Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:25:05.745Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:25:05.745Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:25:05.768Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connection reset; blacklisting for 2 minutes 2021-04-14T11:25:05.769Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:25:05.769Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:25:05.914Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=72ffe7b8-5b79-44a3-85f7-074f1eb77cfd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:25:05.914756Z InvocationID=a2fc0e5c-1cea-4f36-9c4b-90525cb069aa LogTimestamp=2021-04-14T11:25:05.914797Z Entering 2021-04-14T11:25:05.915Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=72ffe7b8-5b79-44a3-85f7-074f1eb77cfd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:25:05.914756Z InvocationID=a2fc0e5c-1cea-4f36-9c4b-90525cb069aa LogTimestamp=2021-04-14T11:25:05.914797Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:25:07.435Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a7f595f-3582-4fde-b72c-e7db5a8666c0 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:07.435Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a7f595f-3582-4fde-b72c-e7db5a8666c0 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:08.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aa3d4d4-79b8-417f-839c-65689a1634e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:08.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aa3d4d4-79b8-417f-839c-65689a1634e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a3481c5 2021-04-14T11:25:08.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aa3d4d4-79b8-417f-839c-65689a1634e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:08.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aa3d4d4-79b8-417f-839c-65689a1634e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:10.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e6d334-cc8a-4699-ba80-a766fbf4117d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:10.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e6d334-cc8a-4699-ba80-a766fbf4117d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20570628 2021-04-14T11:25:10.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e6d334-cc8a-4699-ba80-a766fbf4117d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:10.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e6d334-cc8a-4699-ba80-a766fbf4117d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:11.535Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id fea4834c-d2a8-4e24-b3d5-1bd59d08ced9 2021-04-14T11:25:12.629Z [qtp580718781-17] WARN o.j.d.l.c.ConsistentKeyLocker RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Lock write succeeded but took too long: duration PT1.090542S exceeded limit PT0.5S 2021-04-14T11:25:12.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4a59e2-ed74-4cfb-862f-f2429154913f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:12.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4a59e2-ed74-4cfb-862f-f2429154913f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dad805 2021-04-14T11:25:12.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4a59e2-ed74-4cfb-862f-f2429154913f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:12.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d4a59e2-ed74-4cfb-862f-f2429154913f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:14.515Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource fea4834c-d2a8-4e24-b3d5-1bd59d08ced9 is jh0003 2021-04-14T11:25:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f5ed2a-dab3-4f34-8c0d-d585ec4741ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f5ed2a-dab3-4f34-8c0d-d585ec4741ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ed214ba 2021-04-14T11:25:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f5ed2a-dab3-4f34-8c0d-d585ec4741ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:14.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81f5ed2a-dab3-4f34-8c0d-d585ec4741ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:15.181Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:25:15.182Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:25:15.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:15.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50a6840c 2021-04-14T11:25:15.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:15.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:18.713Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:25:18.713Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:25:18.713Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:18.713Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5d4146a3-f583-465f-93f8-09b14b20b778 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:19.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1072ab16-2ad0-4bbb-85de-30d4e2c5323a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:19.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1072ab16-2ad0-4bbb-85de-30d4e2c5323a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4858ae76 2021-04-14T11:25:19.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1072ab16-2ad0-4bbb-85de-30d4e2c5323a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:19.303Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1072ab16-2ad0-4bbb-85de-30d4e2c5323a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:20.275Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:25:20.275Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:25:22.313Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1072ab16-2ad0-4bbb-85de-30d4e2c5323a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:22.313Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1072ab16-2ad0-4bbb-85de-30d4e2c5323a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:23.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2113e3e6-1ec3-4a55-a963-f5b86cdd5eb5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:23.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2113e3e6-1ec3-4a55-a963-f5b86cdd5eb5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14e9fdb4 2021-04-14T11:25:23.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2113e3e6-1ec3-4a55-a963-f5b86cdd5eb5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:23.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2113e3e6-1ec3-4a55-a963-f5b86cdd5eb5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:24.346Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 lock resource with id c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 2021-04-14T11:25:25.313Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 owner of resource c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 is jh0003 2021-04-14T11:25:26.645Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2113e3e6-1ec3-4a55-a963-f5b86cdd5eb5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:26.646Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2113e3e6-1ec3-4a55-a963-f5b86cdd5eb5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:27.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe22a8fc-70b0-485f-b4fd-ec79f3c18a1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:27.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe22a8fc-70b0-485f-b4fd-ec79f3c18a1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d2da6a8 2021-04-14T11:25:27.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe22a8fc-70b0-485f-b4fd-ec79f3c18a1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:27.515Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe22a8fc-70b0-485f-b4fd-ec79f3c18a1d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:30.525Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fe22a8fc-70b0-485f-b4fd-ec79f3c18a1d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:30.525Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fe22a8fc-70b0-485f-b4fd-ec79f3c18a1d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:33.845Z [qtp580718781-17] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "19c60fe2-0a0f-4b20-a691-cba2bdf010de" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.jsongraph.JanusGraphDao.commit(JanusGraphDao.java:65) at org.openecomp.sdc.be.components.lifecycle.CheckinTransition.changeState(CheckinTransition.java:115) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeState(LifecycleBusinessLogic.java:320) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.checkInBeforeCertifyIfNeeded(LifecycleBusinessLogic.java:272) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeComponentState(LifecycleBusinessLogic.java:217) at org.openecomp.sdc.be.components.lifecycle.LifecycleBusinessLogic.changeState(LifecycleBusinessLogic.java:144) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.nodeFullCertification(ResourceBusinessLogic.java:3869) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.propagateStateToCertified(ResourceBusinessLogic.java:3849) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:231) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:25:34.039Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 owner of resource c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 is jh0003 2021-04-14T11:25:34.039Z [qtp580718781-17] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 validate before certification change. resource name=VNF, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:25:34.039Z [qtp580718781-17] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=dd094b45-b09b-4895-b900-aceb8573cfb1 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 start performing certification change for resource c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 2021-04-14T11:25:34.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca4ab8-6131-4153-927c-8d86dae92d06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:34.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca4ab8-6131-4153-927c-8d86dae92d06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e961dc8 2021-04-14T11:25:34.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca4ab8-6131-4153-927c-8d86dae92d06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:34.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca4ab8-6131-4153-927c-8d86dae92d06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:37.390Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Starting to create Csar for component VNF 2021-04-14T11:25:37.460Z [qtp580718781-17] WARN o.o.s.e.AbstractSdncException AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=900 Received less parameters than expected for error with messageId SVC4063, expected: 1, actual: 0. Missing parameters are padded with null values. 2021-04-14T11:25:37.461Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Operation towards database failed. 2021-04-14T11:25:37.461Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 unlock component c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 2021-04-14T11:25:37.461Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 During change state, another component c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 has been created/updated 2021-04-14T11:25:37.691Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=59ca4ab8-6131-4153-927c-8d86dae92d06 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:37.691Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=59ca4ab8-6131-4153-927c-8d86dae92d06 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:38.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a25e8188-ca44-49ed-b675-eb399ccc641d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:38.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a25e8188-ca44-49ed-b675-eb399ccc641d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@257964b 2021-04-14T11:25:38.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a25e8188-ca44-49ed-b675-eb399ccc641d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:38.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a25e8188-ca44-49ed-b675-eb399ccc641d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:38.386Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState - Certify ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Unexpected error during operation 2021-04-14T11:25:38.386Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource VNF.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=500 Unexpected error during operation 2021-04-14T11:25:38.390Z [qtp580718781-17] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:25:38.391Z [qtp580718781-17] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=900 #uploadMultipart('multipart', /tmp/rep6437028596068098606tmp, 'form-data; filename="VNF.zip"; name="resourceZip"', '{"payloadName": "VNF.yml", "contactId": "jh0003", "name": "VNF", "description": "VNF", "resourceIconPath": "compute", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Infrastructure"}]}], "vendorName": "ETSI", "vendorRelease": "3.3.1", "tags": ["VNF"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByResponseFormatComponentException out of org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic#lambda$decodeToscaArtifactPayload$4[382] in 32s 2021-04-14T11:25:38.392Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR ResponseCode=404 RequestID=null ElapsedTime=32477 PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=145acb5e-3c17-4092-b188-311143151408 TargetServiceName=null ErrorDesc=Not Found EntryTimestamp=2021-04-14T11:25:05.915Z InvocationID=d9bbc64e-ed54-4a5f-824d-9a40856bb3ca ErrorCode=404 LogTimestamp=2021-04-14T11:25:38.392490Z ResponseDesc=Not Found Exiting. 2021-04-14T11:25:38.392Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="404" 2021-04-14T11:25:40.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c51f31a-2753-4e74-9f78-48725e556106 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:40.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c51f31a-2753-4e74-9f78-48725e556106 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2df59311 2021-04-14T11:25:40.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c51f31a-2753-4e74-9f78-48725e556106 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:40.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c51f31a-2753-4e74-9f78-48725e556106 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f262f0-cfc4-424c-b200-dafd9d26bfea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f262f0-cfc4-424c-b200-dafd9d26bfea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2303b33a 2021-04-14T11:25:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f262f0-cfc4-424c-b200-dafd9d26bfea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:40.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28f262f0-cfc4-424c-b200-dafd9d26bfea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:41.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a090391b-9fde-4351-80f6-de545e802c33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:41.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a090391b-9fde-4351-80f6-de545e802c33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae7b00e 2021-04-14T11:25:41.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a090391b-9fde-4351-80f6-de545e802c33 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:41.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a090391b-9fde-4351-80f6-de545e802c33 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:42.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0571b738-f594-4a58-9d7f-8c8696e5dd2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:42.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0571b738-f594-4a58-9d7f-8c8696e5dd2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74bc92d7 2021-04-14T11:25:42.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0571b738-f594-4a58-9d7f-8c8696e5dd2c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:42.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0571b738-f594-4a58-9d7f-8c8696e5dd2c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:42.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2cf1e7e-4b58-4e4b-aadc-c3a722f66d4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:42.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2cf1e7e-4b58-4e4b-aadc-c3a722f66d4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7550fa4a 2021-04-14T11:25:42.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2cf1e7e-4b58-4e4b-aadc-c3a722f66d4c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:42.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2cf1e7e-4b58-4e4b-aadc-c3a722f66d4c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:43.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a894a3f-1662-4551-a7f5-306984e93e0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:43.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a894a3f-1662-4551-a7f5-306984e93e0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b740db9 2021-04-14T11:25:43.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a894a3f-1662-4551-a7f5-306984e93e0c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:43.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a894a3f-1662-4551-a7f5-306984e93e0c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c6b1ad4-31f5-4d9a-965d-ee1d329b5c09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:45.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c6b1ad4-31f5-4d9a-965d-ee1d329b5c09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c64b319 2021-04-14T11:25:45.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c6b1ad4-31f5-4d9a-965d-ee1d329b5c09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:45.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c6b1ad4-31f5-4d9a-965d-ee1d329b5c09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:46.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:46.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c5ea468 2021-04-14T11:25:46.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:46.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:48.547Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2d9b8f8e-9f51-4e71-8be4-59e09281a41a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:25:48.546751Z InvocationID=a9787112-5c1e-458b-b680-78b04b2d9eb4 LogTimestamp=2021-04-14T11:25:48.546845Z Entering 2021-04-14T11:25:48.547Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2d9b8f8e-9f51-4e71-8be4-59e09281a41a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:25:48.546751Z InvocationID=a9787112-5c1e-458b-b680-78b04b2d9eb4 LogTimestamp=2021-04-14T11:25:48.546845Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:25:49.289Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:25:49.289Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:25:49.289Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:49.289Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e6f53505-e10b-4c16-93c5-e2056f1a2f22 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:25:50.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20de1623-b752-4883-bd54-07d781331df5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:50.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20de1623-b752-4883-bd54-07d781331df5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e2e9903 2021-04-14T11:25:50.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20de1623-b752-4883-bd54-07d781331df5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:50.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20de1623-b752-4883-bd54-07d781331df5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:51.229Z [qtp580718781-19] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource VNF.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:25:48.547Z InvocationID=edd39906-ecc2-4b09-b0d0-2619f8b9df9f ErrorCode=500 Unexpected error during operation 2021-04-14T11:25:51.232Z [qtp580718781-19] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this VNF was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:25:48.547Z InvocationID=edd39906-ecc2-4b09-b0d0-2619f8b9df9f ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:25:51.233Z [qtp580718781-19] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this VNF was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:25:48.547Z InvocationID=edd39906-ecc2-4b09-b0d0-2619f8b9df9f ErrorCode=900 #uploadMultipart('multipart', /tmp/rep2601918304905040928tmp, 'form-data; filename="VNF.zip"; name="resourceZip"', '{"payloadName": "VNF.yml", "contactId": "jh0003", "name": "VNF", "description": "VNF", "resourceIconPath": "compute", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Infrastructure"}]}], "vendorName": "ETSI", "vendorRelease": "3.3.1", "tags": ["VNF"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByActionStatusComponentException out of org.openecomp.sdc.be.components.impl.ResourceImportManager#importCertifiedResource[211] in 3s 2021-04-14T11:25:51.235Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this VNF was already promoted." TOSCA_NODE_TYPE = "" ResponseCode=409 RequestID=null ElapsedTime=2687 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null ErrorDesc=Conflict EntryTimestamp=2021-04-14T11:25:48.547Z InvocationID=edd39906-ecc2-4b09-b0d0-2619f8b9df9f ErrorCode=409 LogTimestamp=2021-04-14T11:25:51.234815Z ResponseDesc=Conflict Exiting. 2021-04-14T11:25:51.235Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="409" 2021-04-14T11:25:51.346Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a42c811f-d578-471f-8ef6-7e039fe4b645 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:25:51.345814Z InvocationID=3825f7c3-9e58-4125-97bf-4ddce0fd5efc LogTimestamp=2021-04-14T11:25:51.345860Z Entering 2021-04-14T11:25:51.346Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a42c811f-d578-471f-8ef6-7e039fe4b645 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:25:51.345814Z InvocationID=3825f7c3-9e58-4125-97bf-4ddce0fd5efc LogTimestamp=2021-04-14T11:25:51.345860Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:25:52.913Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id a41f70e0-86fa-40b9-8f79-b3a841b87277 2021-04-14T11:25:53.233Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=20de1623-b752-4883-bd54-07d781331df5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:53.233Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=20de1623-b752-4883-bd54-07d781331df5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:54.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23536695-d753-4d66-b73a-48a5256f9425 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:54.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23536695-d753-4d66-b73a-48a5256f9425 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c39cf73 2021-04-14T11:25:54.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23536695-d753-4d66-b73a-48a5256f9425 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:54.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23536695-d753-4d66-b73a-48a5256f9425 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:54.214Z [qtp580718781-16] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource a41f70e0-86fa-40b9-8f79-b3a841b87277 is jh0003 2021-04-14T11:25:54.688Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "ddeb4c30-3a8c-4419-889e-b5b524076b6b" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:25:54.689Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "ddeb4c30-3a8c-4419-889e-b5b524076b6b" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:25:57.165Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=23536695-d753-4d66-b73a-48a5256f9425 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:25:57.165Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=23536695-d753-4d66-b73a-48a5256f9425 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:25:58.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8267b133-818a-41ae-b5e4-082a664d009e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:25:58.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8267b133-818a-41ae-b5e4-082a664d009e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fd13a59 2021-04-14T11:25:58.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8267b133-818a-41ae-b5e4-082a664d009e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:25:58.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8267b133-818a-41ae-b5e4-082a664d009e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:25:58.369Z [qtp580718781-16] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "ddeb4c30-3a8c-4419-889e-b5b524076b6b" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:25:58.370Z [qtp580718781-16] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "ddeb4c30-3a8c-4419-889e-b5b524076b6b" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.0" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:26:00.135Z [qtp580718781-16] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ddeb4c30-3a8c-4419-889e-b5b524076b6b" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NS" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 lock resource with id 2f1dee2b-5838-4c02-a78a-47159880f87b 2021-04-14T11:26:00.163Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8267b133-818a-41ae-b5e4-082a664d009e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:00.163Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8267b133-818a-41ae-b5e4-082a664d009e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dac7b22-7d5e-4252-b112-371934d0f3e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dac7b22-7d5e-4252-b112-371934d0f3e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a0f82a6 2021-04-14T11:26:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dac7b22-7d5e-4252-b112-371934d0f3e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:00.646Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8dac7b22-7d5e-4252-b112-371934d0f3e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:00.933Z [qtp580718781-16] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "ddeb4c30-3a8c-4419-889e-b5b524076b6b" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.NS" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 owner of resource 2f1dee2b-5838-4c02-a78a-47159880f87b is jh0003 2021-04-14T11:26:01.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7bd798b-b235-4314-8ada-a7358830bf58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:01.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7bd798b-b235-4314-8ada-a7358830bf58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75160a1c 2021-04-14T11:26:01.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7bd798b-b235-4314-8ada-a7358830bf58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:01.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7bd798b-b235-4314-8ada-a7358830bf58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd26022a-2c1f-4f42-bca7-3ec78ceab91e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd26022a-2c1f-4f42-bca7-3ec78ceab91e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2343f515 2021-04-14T11:26:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd26022a-2c1f-4f42-bca7-3ec78ceab91e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd26022a-2c1f-4f42-bca7-3ec78ceab91e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:03.220Z [qtp580718781-16] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 owner of resource 2f1dee2b-5838-4c02-a78a-47159880f87b is jh0003 2021-04-14T11:26:03.221Z [qtp580718781-16] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 validate before certification change. resource name=NS, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:26:03.221Z [qtp580718781-16] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "1.1" CURR_VERSION = "1.1" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=009ab94d-0192-4955-ab61-6b67ae62bfad TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 start performing certification change for resource 2f1dee2b-5838-4c02-a78a-47159880f87b 2021-04-14T11:26:04.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbaa13be-5872-4eee-ad7a-11d88ba1cac5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:04.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbaa13be-5872-4eee-ad7a-11d88ba1cac5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57acc454 2021-04-14T11:26:04.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbaa13be-5872-4eee-ad7a-11d88ba1cac5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:04.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cbaa13be-5872-4eee-ad7a-11d88ba1cac5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:26:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:26:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:26:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:26:06.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=610c0590-6090-4c65-8a60-797c86ffde3d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:06.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=610c0590-6090-4c65-8a60-797c86ffde3d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41a066b5 2021-04-14T11:26:06.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=610c0590-6090-4c65-8a60-797c86ffde3d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:06.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=610c0590-6090-4c65-8a60-797c86ffde3d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:08.311Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:26:08.314Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:26:08.314Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:26:08.835Z [qtp580718781-16] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 Starting to create Csar for component NS 2021-04-14T11:26:08.843Z [qtp580718781-16] WARN o.o.s.e.AbstractSdncException AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity= ErrorCategory=WARN ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=900 Received less parameters than expected for error with messageId SVC4063, expected: 1, actual: 0. Missing parameters are padded with null values. 2021-04-14T11:26:08.844Z [qtp580718781-16] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 Operation towards database failed. 2021-04-14T11:26:08.845Z [qtp580718781-16] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 unlock component 2f1dee2b-5838-4c02-a78a-47159880f87b 2021-04-14T11:26:08.845Z [qtp580718781-16] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 During change state, another component 2f1dee2b-5838-4c02-a78a-47159880f87b has been created/updated 2021-04-14T11:26:09.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c2a19a-79d1-4152-8786-077d54ea27d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:09.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c2a19a-79d1-4152-8786-077d54ea27d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@423c277 2021-04-14T11:26:09.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c2a19a-79d1-4152-8786-077d54ea27d2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:09.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64c2a19a-79d1-4152-8786-077d54ea27d2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:10.010Z [qtp580718781-16] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Change LifecycleState - Certify ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 Unexpected error during operation 2021-04-14T11:26:10.010Z [qtp580718781-16] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "NS" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "009ab94d-0192-4955-ab61-6b67ae62bfad" INVARIANT_UUID = "128342e3-8a46-4a24-886c-ee2d3817637c" PREV_VERSION = "" CURR_VERSION = "1.1" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" CURR_ARTIFACT_UUID = "a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Ns-template.yml,0,a41f70e0-86fa-40b9-8f79-b3a841b87277.assettoscatemplate,1,50f7c663-c189-4ba9-9710-c9909037bd39" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource NS.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=500 Unexpected error during operation 2021-04-14T11:26:10.013Z [qtp580718781-16] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:26:10.016Z [qtp580718781-16] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=900 #uploadMultipart('multipart', /tmp/rep6463478404735478975tmp, 'form-data; filename="NS.zip"; name="resourceZip"', '{"payloadName": "NS.yml", "contactId": "jh0003", "name": "NS", "description": "ETSI NS", "resourceIconPath": "network", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Network Elements"}]}], "vendorName": "ETSI", "vendorRelease": "3.3.1", "tags": ["NS"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByResponseFormatComponentException out of org.openecomp.sdc.be.components.impl.ArtifactsBusinessLogic#lambda$decodeToscaArtifactPayload$4[382] in 19s 2021-04-14T11:26:10.020Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "404" DESC = "SVC4063: Error: Requested 'null' resource was not found." TOSCA_NODE_TYPE = "" SupportablityAction=GENERATE CSAR ResponseCode=404 RequestID=null ElapsedTime=18673 PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=1e4fca09-8495-48fc-884b-da1db0a1b3b8 TargetServiceName=null ErrorDesc=Not Found EntryTimestamp=2021-04-14T11:25:51.346Z InvocationID=6ea1df2a-ca5c-4e4f-8786-3d37502d4b05 ErrorCode=404 LogTimestamp=2021-04-14T11:26:10.019370Z ResponseDesc=Not Found Exiting. 2021-04-14T11:26:10.020Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="404" 2021-04-14T11:26:11.011Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9261be0a-a0fb-46da-b6da-e1ac0ca557ee InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.93 StatusCode=INPROGRESS RemoteHost=10.242.70.93 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:11.010827Z InvocationID=8623530c-4dc2-4dcb-8fa6-58f4cb513d24 LogTimestamp=2021-04-14T11:26:11.010879Z Entering 2021-04-14T11:26:11.011Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9261be0a-a0fb-46da-b6da-e1ac0ca557ee InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.93 StatusCode=INPROGRESS userId=null RemoteHost=10.242.70.93 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:11.010827Z InvocationID=8623530c-4dc2-4dcb-8fa6-58f4cb513d24 LogTimestamp=2021-04-14T11:26:11.010879Z localAddr=10.242.62.146 remoteAddr=10.242.70.93 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:26:11.014Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:26:11.011Z InvocationID=9d1a4965-d66d-4ad1-9933-1fe529b722dd LogTimestamp=2021-04-14T11:26:11.014030Z ResponseDesc=OK Exiting. 2021-04-14T11:26:11.014Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:26:12.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcf8a971-2ed6-487b-a4d1-ffe9ea51ce64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:12.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcf8a971-2ed6-487b-a4d1-ffe9ea51ce64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38f464bb 2021-04-14T11:26:12.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcf8a971-2ed6-487b-a4d1-ffe9ea51ce64 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:12.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcf8a971-2ed6-487b-a4d1-ffe9ea51ce64 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:14.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3992f7-6112-426a-a405-559e3aee8b52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:14.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3992f7-6112-426a-a405-559e3aee8b52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@94b9995 2021-04-14T11:26:14.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3992f7-6112-426a-a405-559e3aee8b52 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:14.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c3992f7-6112-426a-a405-559e3aee8b52 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:18.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34667ed1-12ff-471e-a6f5-8a836c0f0854 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:18.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34667ed1-12ff-471e-a6f5-8a836c0f0854 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b9cd3c7 2021-04-14T11:26:18.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34667ed1-12ff-471e-a6f5-8a836c0f0854 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:18.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34667ed1-12ff-471e-a6f5-8a836c0f0854 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:20.073Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1c6b7222-1e0b-441c-b5b8-0dc7de6638d2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:20.073289Z InvocationID=2f4f6732-5258-4e09-bf08-b5cc19d03b8f LogTimestamp=2021-04-14T11:26:20.073410Z Entering 2021-04-14T11:26:20.074Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1c6b7222-1e0b-441c-b5b8-0dc7de6638d2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:20.073289Z InvocationID=2f4f6732-5258-4e09-bf08-b5cc19d03b8f LogTimestamp=2021-04-14T11:26:20.073410Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:26:21.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:21.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@513680b9 2021-04-14T11:26:21.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:21.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:21.246Z [qtp580718781-12] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Import Resource NS.yml ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:20.074Z InvocationID=b9fd53f4-1cdb-49ff-a3b5-eb97459c66ec ErrorCode=500 Unexpected error during operation 2021-04-14T11:26:21.249Z [qtp580718781-12] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this NS was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:20.074Z InvocationID=b9fd53f4-1cdb-49ff-a3b5-eb97459c66ec ErrorCode=900 Unexpected error during BE REST API execution 2021-04-14T11:26:21.249Z [qtp580718781-12] ERROR o.o.s.b.s.ResourceUploadServlet AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this NS was already promoted." TOSCA_NODE_TYPE = "" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:20.074Z InvocationID=b9fd53f4-1cdb-49ff-a3b5-eb97459c66ec ErrorCode=900 #uploadMultipart('multipart', /tmp/rep9548627588018593995tmp, 'form-data; filename="NS.zip"; name="resourceZip"', '{"payloadName": "NS.yml", "contactId": "jh0003", "name": "NS", "description": "ETSI NS", "resourceIconPath": "network", "resourceType": "VFC", "categories": [{"name": "Generic", "subcategories": [{"name": "Network Elements"}]}], "vendorName": "ETSI", "vendorRelease": "3.3.1", "tags": ["NS"]}', 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/upload/multipart?createNewVersion=true)@655eb9d4', 'jh0003', true): thrown org.openecomp.sdc.be.components.impl.exceptions.ByActionStatusComponentException out of org.openecomp.sdc.be.components.impl.ResourceImportManager#importCertifiedResource[211] in 1s 2021-04-14T11:26:21.250Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "NS" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "1.0" CURR_VERSION = "" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "CERTIFIED" CURR_STATE = "" STATUS = "409" DESC = "SVC4083: Error: Version of this NS was already promoted." TOSCA_NODE_TYPE = "" ResponseCode=409 RequestID=null ElapsedTime=1176 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=Upload Resource ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null ErrorDesc=Conflict EntryTimestamp=2021-04-14T11:26:20.074Z InvocationID=b9fd53f4-1cdb-49ff-a3b5-eb97459c66ec ErrorCode=409 LogTimestamp=2021-04-14T11:26:21.250490Z ResponseDesc=Conflict Exiting. 2021-04-14T11:26:21.250Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="409" 2021-04-14T11:26:21.373Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a73433d5-0796-46e3-8e7e-67efab5409f6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:21.373052Z InvocationID=648a454f-b99e-49e1-a39f-b74ea6d232d7 LogTimestamp=2021-04-14T11:26:21.373095Z Entering 2021-04-14T11:26:21.373Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a73433d5-0796-46e3-8e7e-67efab5409f6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:21.373052Z InvocationID=648a454f-b99e-49e1-a39f-b74ea6d232d7 LogTimestamp=2021-04-14T11:26:21.373095Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:26:23.631Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with id c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 2021-04-14T11:26:24.038Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:26:24.039Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:26:24.039Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:24.039Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c62e4cf3-52b4-4a0a-af69-b3448cea35ee ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:24.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dafa1-f13b-4bfc-8a8c-8eb89d3d7d6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:24.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dafa1-f13b-4bfc-8a8c-8eb89d3d7d6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4afce798 2021-04-14T11:26:24.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dafa1-f13b-4bfc-8a8c-8eb89d3d7d6d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:24.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dafa1-f13b-4bfc-8a8c-8eb89d3d7d6d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:25.930Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m owner of resource c9c8e631-d8c7-4aaf-a8f3-f63e2a8390d4 is jh0003 2021-04-14T11:26:27.940Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c65dafa1-f13b-4bfc-8a8c-8eb89d3d7d6d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:26:27.941Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c65dafa1-f13b-4bfc-8a8c-8eb89d3d7d6d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:26:28.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b49a9b-5d9b-444e-a458-1eb740a4862d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:28.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b49a9b-5d9b-444e-a458-1eb740a4862d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3281a2ba 2021-04-14T11:26:28.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b49a9b-5d9b-444e-a458-1eb740a4862d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:28.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b49a9b-5d9b-444e-a458-1eb740a4862d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:30.138Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:26:30.139Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:26:31.593Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=53b49a9b-5d9b-444e-a458-1eb740a4862d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:26:31.594Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=53b49a9b-5d9b-444e-a458-1eb740a4862d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:26:32.133Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:26:32.134Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "Checkout" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.1" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" COMMENT = "update by import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:26:32.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83f94a5-91e5-4aaf-b583-5ec5719f4139 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:32.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83f94a5-91e5-4aaf-b583-5ec5719f4139 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a3a224e 2021-04-14T11:26:32.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83f94a5-91e5-4aaf-b583-5ec5719f4139 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:32.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b83f94a5-91e5-4aaf-b583-5ec5719f4139 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:34.535Z [qtp580718781-17] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 lock resource with id 1b331520-231f-4398-9727-edb72e29a235 2021-04-14T11:26:35.239Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b83f94a5-91e5-4aaf-b583-5ec5719f4139 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:26:35.239Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b83f94a5-91e5-4aaf-b583-5ec5719f4139 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:26:35.581Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKOUT" STATUS = "200" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VNF" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 owner of resource 1b331520-231f-4398-9727-edb72e29a235 is jh0003 2021-04-14T11:26:35.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7785bdfc-1ff5-4324-b520-a88c8f21bc5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:35.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7785bdfc-1ff5-4324-b520-a88c8f21bc5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2891f415 2021-04-14T11:26:35.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7785bdfc-1ff5-4324-b520-a88c8f21bc5c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:35.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7785bdfc-1ff5-4324-b520-a88c8f21bc5c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:38.529Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7785bdfc-1ff5-4324-b520-a88c8f21bc5c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:38.530Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7785bdfc-1ff5-4324-b520-a88c8f21bc5c ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:39.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5adc0-c7ee-4002-95c1-da430ca5ffa7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:39.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5adc0-c7ee-4002-95c1-da430ca5ffa7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a54ab3d 2021-04-14T11:26:39.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5adc0-c7ee-4002-95c1-da430ca5ffa7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:39.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf5adc0-c7ee-4002-95c1-da430ca5ffa7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:39.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9b089f-0364-442f-a6c3-37c8d93b0de8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:39.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9b089f-0364-442f-a6c3-37c8d93b0de8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2da8dd1d 2021-04-14T11:26:39.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9b089f-0364-442f-a6c3-37c8d93b0de8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:39.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa9b089f-0364-442f-a6c3-37c8d93b0de8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:39.655Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 owner of resource 1b331520-231f-4398-9727-edb72e29a235 is jh0003 2021-04-14T11:26:39.655Z [qtp580718781-17] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 validate before certification change. resource name=VNF, oldState=NOT_CERTIFIED_CHECKIN, owner userId=jh0003 2021-04-14T11:26:39.655Z [qtp580718781-17] INFO o.o.s.b.c.l.CertificationChangeTransition AuditMessage=ACTION = "Checkin" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "1.2" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKOUT" CURR_STATE = "NOT_CERTIFIED_CHECKIN" COMMENT = "certification on import" STATUS = "200" DESC = "OK" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 start performing certification change for resource 1b331520-231f-4398-9727-edb72e29a235 2021-04-14T11:26:40.487Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.2" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5f182284-bcfe-4121-a110-2369542536a1 TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 Starting to create Csar for component VNF 2021-04-14T11:26:40.711Z [qtp580718781-17] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "" CURR_VERSION = "1.2" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "NOT_CERTIFIED_CHECKIN" PREV_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" CURR_ARTIFACT_UUID = "fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Vnf-template.yml,0,fea4834c-d2a8-4e24-b3d5-1bd59d08ced9.assettoscatemplate,1,75336ea7-53d2-4916-9b40-d090a80d9023" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=5f182284-bcfe-4121-a110-2369542536a1 TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 Ended create Csar for component VNF 2021-04-14T11:26:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8773d1ef-5b37-4f8a-b48e-e63995fe494f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8773d1ef-5b37-4f8a-b48e-e63995fe494f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@abea5e1 2021-04-14T11:26:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8773d1ef-5b37-4f8a-b48e-e63995fe494f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8773d1ef-5b37-4f8a-b48e-e63995fe494f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:41.691Z [qtp580718781-17] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f304d4ed-2d67-4057-b6b6-84668c213b8a TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:26:41.692Z [qtp580718781-17] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f304d4ed-2d67-4057-b6b6-84668c213b8a TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:26:41.692Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f304d4ed-2d67-4057-b6b6-84668c213b8a TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 unlock component 1b331520-231f-4398-9727-edb72e29a235 2021-04-14T11:26:41.692Z [qtp580718781-17] INFO o.o.s.b.c.l.LifecycleBusinessLogic AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f304d4ed-2d67-4057-b6b6-84668c213b8a TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 During change state, another component 1b331520-231f-4398-9727-edb72e29a235 has been created/updated 2021-04-14T11:26:42.270Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "CertificationSuccess" RESOURCE_NAME = "VNF" RESOURCE_TYPE = "Resource" SERVICE_INSTANCE_ID = "dd094b45-b09b-4895-b900-aceb8573cfb1" INVARIANT_UUID = "20237c01-58e1-463c-ab89-82ee9158f8e4" PREV_VERSION = "1.2" CURR_VERSION = "2.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "NOT_CERTIFIED_CHECKIN" CURR_STATE = "CERTIFIED" COMMENT = "certification on import" STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=20896 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=f304d4ed-2d67-4057-b6b6-84668c213b8a TargetServiceName=null EntryTimestamp=2021-04-14T11:26:21.373Z InvocationID=74641670-967e-47a8-8c6d-11554f41e28b ErrorCode=500 LogTimestamp=2021-04-14T11:26:42.269227Z ResponseDesc=Created Exiting. 2021-04-14T11:26:42.270Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:26:42.322Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5416ae8f-e269-477d-ae91-26425f05bcf5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:42.321852Z InvocationID=970cce3e-645c-478c-8195-6e63638325b7 LogTimestamp=2021-04-14T11:26:42.321925Z Entering 2021-04-14T11:26:42.322Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5416ae8f-e269-477d-ae91-26425f05bcf5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/upload/multipart ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:42.321852Z InvocationID=970cce3e-645c-478c-8195-6e63638325b7 LogTimestamp=2021-04-14T11:26:42.321925Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:26:43.027Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:43.027Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:43.027Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:43.027Z [qtp580718781-11] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:43.030Z [qtp580718781-11] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=400 Capability Type tosca.capabilities.nfv.ContainerGroupable required is missing 2021-04-14T11:26:43.030Z [qtp580718781-11] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 Operation towards database failed. 2021-04-14T11:26:43.113Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "400" DESC = "SVC4115: Error: Invalid Content. Missing Capability Type 'tosca.capabilities.nfv.ContainerGroupable'." TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainer" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 lock resource with name Oscontainer 2021-04-14T11:26:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=011e333f-4848-47c2-8daa-f9a7038257c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=011e333f-4848-47c2-8daa-f9a7038257c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75deaa3c 2021-04-14T11:26:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=011e333f-4848-47c2-8daa-f9a7038257c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:45.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=011e333f-4848-47c2-8daa-f9a7038257c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:46.612Z [qtp580718781-11] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainer" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=558d4772-06d3-44b2-a6cf-ff79ebcad71d TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:26:46.613Z [qtp580718781-11] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainer" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=558d4772-06d3-44b2-a6cf-ff79ebcad71d TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:26:48.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28a506ad-bc21-4e63-b6f0-655477ceab04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:48.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28a506ad-bc21-4e63-b6f0-655477ceab04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a1ceaf9 2021-04-14T11:26:48.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28a506ad-bc21-4e63-b6f0-655477ceab04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:48.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28a506ad-bc21-4e63-b6f0-655477ceab04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:49.839Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainer" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=558d4772-06d3-44b2-a6cf-ff79ebcad71d TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 lock resource with id 4c82eae6-a180-4b40-b903-5cac3fb0c57b 2021-04-14T11:26:51.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc57996-6148-44d7-aee1-4a8c82e0adf5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:51.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc57996-6148-44d7-aee1-4a8c82e0adf5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51b78892 2021-04-14T11:26:51.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc57996-6148-44d7-aee1-4a8c82e0adf5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:51.655Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cc57996-6148-44d7-aee1-4a8c82e0adf5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:52.811Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate" CURR_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oscontainer-template.yml,0,4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cef418de-6044-475a-adae-17f8d573429c TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 Starting to create Csar for component osContainer 2021-04-14T11:26:53.020Z [qtp580718781-11] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate" CURR_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oscontainer-template.yml,0,4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cef418de-6044-475a-adae-17f8d573429c TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 Ended create Csar for component osContainer 2021-04-14T11:26:53.021Z [qtp580718781-11] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate" CURR_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oscontainer-template.yml,0,4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=cef418de-6044-475a-adae-17f8d573429c TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 lock resource with id 4c82eae6-a180-4b40-b903-5cac3fb0c57b 2021-04-14T11:26:54.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:54.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e59bee8 2021-04-14T11:26:54.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:54.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:55.362Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainer" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "558d4772-06d3-44b2-a6cf-ff79ebcad71d" INVARIANT_UUID = "c2ebe368-59bd-4251-b3ea-e2728bc4ea95" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscacsar" CURR_ARTIFACT_UUID = "4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Oscontainer-csar.csar,0,4c82eae6-a180-4b40-b903-5cac3fb0c57b.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=13039 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=ec5e62b1-9749-4cee-9799-b926d1a75680 TargetServiceName=null EntryTimestamp=2021-04-14T11:26:42.323Z InvocationID=90a31a25-1a9a-4b22-8504-5ef57a33284e ErrorCode=500 LogTimestamp=2021-04-14T11:26:55.362024Z ResponseDesc=Created Exiting. 2021-04-14T11:26:55.362Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:26:55.592Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f1ec66e5-a403-49ac-ac63-fe004791436f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:55.591907Z InvocationID=239f59c5-2b2f-4a3c-b5c1-d5fb0ef74548 LogTimestamp=2021-04-14T11:26:55.591957Z Entering 2021-04-14T11:26:55.592Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f1ec66e5-a403-49ac-ac63-fe004791436f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:26:55.591907Z InvocationID=239f59c5-2b2f-4a3c-b5c1-d5fb0ef74548 LogTimestamp=2021-04-14T11:26:55.591957Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:26:57.218Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:26:57.219Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:26:57.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:57.219Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a0549bc0-6b93-46a9-b5af-7f0ed95d68ea ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:26:59.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db86e84-2658-410b-b5bd-b598182d9052 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:26:59.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db86e84-2658-410b-b5bd-b598182d9052 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e567e55 2021-04-14T11:26:59.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db86e84-2658-410b-b5bd-b598182d9052 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:26:59.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9db86e84-2658-410b-b5bd-b598182d9052 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:26:59.341Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:59.341Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:59.341Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:59.341Z [qtp580718781-15] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:26:59.452Z [qtp580718781-15] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=400 Capability Type tosca.capabilities.nfv.ContainerGroupable required is missing 2021-04-14T11:26:59.452Z [qtp580718781-15] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 Operation towards database failed. 2021-04-14T11:26:59.455Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "" INVARIANT_UUID = "" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "400" DESC = "SVC4115: Error: Invalid Content. Missing Capability Type 'tosca.capabilities.nfv.ContainerGroupable'." TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainerGroup" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 lock resource with name Oscontainergroup 2021-04-14T11:27:02.340Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9db86e84-2658-410b-b5bd-b598182d9052 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:02.340Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=9db86e84-2658-410b-b5bd-b598182d9052 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:03.515Z [qtp580718781-15] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainerGroup" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=Create Resource - validateCapabilityTypesCreate ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=61bf186f-42db-499e-8fcb-ee4887f05ed6 TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:27:03.515Z [qtp580718781-15] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainerGroup" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=61bf186f-42db-499e-8fcb-ee4887f05ed6 TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:27:03.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e30e4c0-7028-406e-b51a-5cc6d110746b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:03.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e30e4c0-7028-406e-b51a-5cc6d110746b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e5ef7a6 2021-04-14T11:27:03.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e30e4c0-7028-406e-b51a-5cc6d110746b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:03.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e30e4c0-7028-406e-b51a-5cc6d110746b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:27:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:27:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:27:04.361Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:27:04.361Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:27:04.362Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:27:05.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460ab446-8636-43a2-b078-b5a19e5938d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:05.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460ab446-8636-43a2-b078-b5a19e5938d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d13a47b 2021-04-14T11:27:05.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460ab446-8636-43a2-b078-b5a19e5938d2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:05.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=460ab446-8636-43a2-b078-b5a19e5938d2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:06.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8745d5-8619-4e94-9c30-520f90765e2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:06.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8745d5-8619-4e94-9c30-520f90765e2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60aac95a 2021-04-14T11:27:06.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8745d5-8619-4e94-9c30-520f90765e2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:06.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd8745d5-8619-4e94-9c30-520f90765e2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:08.197Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.Vdu.osContainerGroup" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=61bf186f-42db-499e-8fcb-ee4887f05ed6 TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 lock resource with id 70262b45-dc29-4440-ab8c-aaa0607c4d78 2021-04-14T11:27:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d23d0c-044a-40ec-8d60-0158bd32345e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d23d0c-044a-40ec-8d60-0158bd32345e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@130ba529 2021-04-14T11:27:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d23d0c-044a-40ec-8d60-0158bd32345e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:09.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38d23d0c-044a-40ec-8d60-0158bd32345e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:12.313Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate" CURR_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oscontainergroup-template.yml,0,70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=301e4edc-051f-41fc-b97f-7927978c0fbd TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 Starting to create Csar for component osContainerGroup 2021-04-14T11:27:12.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:12.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a018329 2021-04-14T11:27:12.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:12.440Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:12.538Z [qtp580718781-15] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate" CURR_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oscontainergroup-template.yml,0,70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=301e4edc-051f-41fc-b97f-7927978c0fbd TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 Ended create Csar for component osContainerGroup 2021-04-14T11:27:12.539Z [qtp580718781-15] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate" CURR_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-Oscontainergroup-template.yml,0,70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=301e4edc-051f-41fc-b97f-7927978c0fbd TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 lock resource with id 70262b45-dc29-4440-ab8c-aaa0607c4d78 2021-04-14T11:27:15.445Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:27:15.446Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:27:15.446Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:15.446Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=daf1fb83-707c-495c-9077-960c0a38ed90 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:16.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41c1843-ed39-4624-b447-0babd35e381a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:16.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41c1843-ed39-4624-b447-0babd35e381a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a51d06e 2021-04-14T11:27:16.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41c1843-ed39-4624-b447-0babd35e381a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:16.381Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41c1843-ed39-4624-b447-0babd35e381a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:16.402Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "osContainerGroup" RESOURCE_TYPE = "VFC" SERVICE_INSTANCE_ID = "61bf186f-42db-499e-8fcb-ee4887f05ed6" INVARIANT_UUID = "12df7679-42fd-4b12-9250-b2f1c6761586" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscacsar" CURR_ARTIFACT_UUID = "70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-Oscontainergroup-csar.csar,0,70262b45-dc29-4440-ab8c-aaa0607c4d78.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=20808 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=893d00d5-045e-4b7a-966a-e98e9d19be5e TargetServiceName=null EntryTimestamp=2021-04-14T11:26:55.593Z InvocationID=49c7be90-6af8-4ab5-98c3-5be35e64a6d2 ErrorCode=500 LogTimestamp=2021-04-14T11:27:16.401782Z ResponseDesc=Created Exiting. 2021-04-14T11:27:16.402Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:27:16.535Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5f20cef7-1ffc-4b49-87ae-6837683d314b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:27:16.535002Z InvocationID=fd48cc71-da87-445f-964a-9253040c5e0c LogTimestamp=2021-04-14T11:27:16.535050Z Entering 2021-04-14T11:27:16.535Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5f20cef7-1ffc-4b49-87ae-6837683d314b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServiceName=v1/catalog/upload/multipart ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:27:16.535002Z InvocationID=fd48cc71-da87-445f-964a-9253040c5e0c LogTimestamp=2021-04-14T11:27:16.535050Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 2021-04-14T11:27:20.849Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d41c1843-ed39-4624-b447-0babd35e381a ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:20.849Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d41c1843-ed39-4624-b447-0babd35e381a ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:21.475Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m LifecycleState cannot be defined by user. This field will be overridden by the application 2021-04-14T11:27:21.475Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:27:21.475Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Creator cannot be defined by user. This field will be overridden by the application 2021-04-14T11:27:21.475Z [qtp580718781-19] INFO o.o.s.b.c.i.ComponentBusinessLogic RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Is Highest Version cannot be defined by user. This field will be overridden by the application 2021-04-14T11:27:21.535Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m lock resource with name VirtualCp 2021-04-14T11:27:22.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932caf6c-43cb-4f2a-915a-2f7ac37da925 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:22.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932caf6c-43cb-4f2a-915a-2f7ac37da925 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@626bf023 2021-04-14T11:27:22.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932caf6c-43cb-4f2a-915a-2f7ac37da925 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:22.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=932caf6c-43cb-4f2a-915a-2f7ac37da925 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:23.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460cf22-5b96-49c8-b78b-2c00ff1f580a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:23.635Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460cf22-5b96-49c8-b78b-2c00ff1f580a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14852f8c 2021-04-14T11:27:23.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460cf22-5b96-49c8-b78b-2c00ff1f580a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:23.636Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460cf22-5b96-49c8-b78b-2c00ff1f580a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:24.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42899ae3-b440-45ca-9b5a-d7f93cd16457 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:24.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42899ae3-b440-45ca-9b5a-d7f93cd16457 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@434fd2 2021-04-14T11:27:24.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42899ae3-b440-45ca-9b5a-d7f93cd16457 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:24.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42899ae3-b440-45ca-9b5a-d7f93cd16457 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:27:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:27:30.010Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:27:31.338Z [qtp580718781-19] INFO o.j.d.util.BackendOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VirtualCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d3fccaf0-0201-4ff5-b477-11ddf40aabc4 EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m Temporary exception during backend operation [CacheMutation]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:504) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:435) at org.janusgraph.diskstorage.locking.consistentkey.ExpectedValueCheckingStoreManager.mutateMany(ExpectedValueCheckingStoreManager.java:76) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:94) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction$1.call(CacheTransaction.java:91) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:91) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:139) at org.janusgraph.diskstorage.keycolumnvalue.cache.CacheTransaction.commit(CacheTransaction.java:196) at org.janusgraph.diskstorage.BackendTransaction.commitStorage(BackendTransaction.java:134) at org.janusgraph.graphdb.database.StandardJanusGraph.commit(StandardJanusGraph.java:733) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.commit(StandardJanusGraphTx.java:1379) at org.janusgraph.graphdb.tinkerpop.JanusGraphBlueprintsGraph$GraphTransaction.doCommit(JanusGraphBlueprintsGraph.java:298) at org.apache.tinkerpop.gremlin.structure.util.AbstractTransaction.commit(AbstractTransaction.java:104) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.commit(JanusGraphClient.java:279) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.unlockNode(JanusGraphGenericDao.java:1423) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.releaseElement(JanusGraphGenericDao.java:1435) at org.openecomp.sdc.be.model.operations.impl.GraphLockOperation.unlockComponentByName(GraphLockOperation.java:77) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByDao(ResourceBusinessLogic.java:4449) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createResourceByImport(ResourceBusinessLogic.java:3967) at org.openecomp.sdc.be.components.impl.ResourceBusinessLogic.createOrUpdateResourceByImport(ResourceBusinessLogic.java:3916) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importCertifiedResource(ResourceImportManager.java:215) at org.openecomp.sdc.be.components.impl.ResourceImportManager.importNormativeResource(ResourceImportManager.java:157) at org.openecomp.sdc.be.servlets.AbstractValidationsServlet.handleImport(AbstractValidationsServlet.java:707) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart_aroundBody0(ResourceUploadServlet.java:180) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$AjcClosure1.run(ResourceUploadServlet.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.jcabi.aspects.aj.MethodLogger.wrap(MethodLogger.java:212) at com.jcabi.aspects.aj.MethodLogger.ajc$inlineAccessMethod$com_jcabi_aspects_aj_MethodLogger$com_jcabi_aspects_aj_MethodLogger$wrap(MethodLogger.java:1) at com.jcabi.aspects.aj.MethodLogger.wrapClass(MethodLogger.java:136) at org.openecomp.sdc.be.servlets.ResourceUploadServlet.uploadMultipart(ResourceUploadServlet.java:154) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$FastClassBySpringCGLIB$$6732af97.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:771) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:56) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:749) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:691) at org.openecomp.sdc.be.servlets.ResourceUploadServlet$$EnhancerBySpringCGLIB$$42a44ec8.uploadMultipart() at jdk.internal.reflect.GeneratedMethodAccessor349.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.base/java.lang.reflect.Method.invoke(Unknown Source) at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191) at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200) at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103) at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415) at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104) at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272) at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268) at org.glassfish.jersey.internal.Errors.process(Errors.java:316) at org.glassfish.jersey.internal.Errors.process(Errors.java:298) at org.glassfish.jersey.internal.Errors.process(Errors.java:268) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289) at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256) at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703) at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416) at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342) at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1411) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:763) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1651) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:226) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.togglz.servlet.TogglzFilter.doFilter(TogglzFilter.java:100) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.ReqValidationFilter.doFilter(ReqValidationFilter.java:75) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1638) at org.openecomp.sdc.be.filters.GatewayFilter.doFilter(GatewayFilter.java:76) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:358) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:271) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:501) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395) at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.exceptions.WriteTimeoutException.copy(WriteTimeoutException.java:113) at com.datastax.driver.core.Responses$Error.asException(Responses.java:167) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.WriteTimeoutException: Cassandra timeout during SIMPLE write query at consistency QUORUM (2 replica were required but only 1 acknowledged the write) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:87) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:27:31.651Z [qtp580718781-19] INFO o.o.s.b.c.d.e.DmaapClientFactory AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VirtualCp" RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d3fccaf0-0201-4ff5-b477-11ddf40aabc4 EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m The DmaapProducerConfiguration is DmaapProducerConfiguration(active=true, hosts=olsd004.com:3905, consumerGroup=sdc-AUTO-1618398018, consumerId=sdc-AUTO1-1618398018, timeoutMs=15000, limit=1, pollingInterval=2, topic=SDC-FACADE-NOTIF-v1, latitude=32.109333, longitude=34.855499, version=1.0, serviceName=dmaap.com:3905/events, environment=TEST, partner=BOT_R, routeOffer=MR1, protocol=null, contenttype=application/json, dme2TraceOn=true, aftEnvironment=null, aftDme2ConnectionTimeoutMs=15000, aftDme2RoundtripTimeoutMs=240000, aftDme2ReadTimeoutMs=50000, dme2preferredRouterFilePath=null, credential=Credential [username=user1@sdc.com, password=password==], timeLimitForNotificationHandleMs=120000, aftDme2SslEnable=true, aftDme2ClientIgnoreSslConfig=false, aftDme2ClientKeystore=/var/lib/jetty/etc/truststore, aftDme2ClientKeystorePassword=dmaap_truststore_pwd, aftDme2ClientSslCertAlias=certman) 2021-04-14T11:27:31.652Z [qtp580718781-19] ERROR o.o.s.be.catalog.impl.DmaapProducer AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VirtualCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d3fccaf0-0201-4ff5-b477-11ddf40aabc4 TargetServiceName=null EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 ErrorCode=500 Failed to connect to topic . Exeption Input byte array has wrong 4-byte ending unit 2021-04-14T11:27:33.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=222f9053-e522-4a9a-8972-d9a12c7f8b64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:33.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=222f9053-e522-4a9a-8972-d9a12c7f8b64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@158289bf 2021-04-14T11:27:33.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=222f9053-e522-4a9a-8972-d9a12c7f8b64 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:33.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=222f9053-e522-4a9a-8972-d9a12c7f8b64 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:33.653Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ResourceImport" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "Jimmy Hendrix(jh0003)" PREV_STATE = "" CURR_STATE = "CERTIFIED" STATUS = "201" DESC = "OK" TOSCA_NODE_TYPE = "tosca.nodes.nfv.VirtualCp" RequestID=null PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=d3fccaf0-0201-4ff5-b477-11ddf40aabc4 TargetServiceName=null EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 ErrorCode=500 lock resource with id c586c22c-3c3b-424d-84ce-63033fbaa90a 2021-04-14T11:27:34.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=577ff322-1c17-4261-976a-6d483104d5c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:34.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=577ff322-1c17-4261-976a-6d483104d5c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@285599c4 2021-04-14T11:27:34.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=577ff322-1c17-4261-976a-6d483104d5c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:34.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=577ff322-1c17-4261-976a-6d483104d5c5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:36.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c7b2305-ec1a-4e8e-970e-a5f15a6e0f74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:36.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c7b2305-ec1a-4e8e-970e-a5f15a6e0f74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15113a0d 2021-04-14T11:27:36.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c7b2305-ec1a-4e8e-970e-a5f15a6e0f74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:36.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c7b2305-ec1a-4e8e-970e-a5f15a6e0f74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:37.284Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate" CURR_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VirtualCp-template.yml,0,c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=STARTED ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=556f3dd7-c112-43c8-bc5b-104874f26ca0 TargetServiceName=null EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 ErrorCode=500 Starting to create Csar for component Virtual Cp 2021-04-14T11:27:37.992Z [qtp580718781-19] INFO org.openecomp.sdc.be.tosca.CsarUtils AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate" CURR_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VirtualCp-template.yml,0,c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=556f3dd7-c112-43c8-bc5b-104874f26ca0 TargetServiceName=null EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 ErrorCode=500 Ended create Csar for component Virtual Cp 2021-04-14T11:27:37.992Z [qtp580718781-19] INFO o.o.s.b.m.o.impl.GraphLockOperation AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate" CURR_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate" ARTIFACT_DATA = "TOSCA,'assettoscatemplate',TOSCA_TEMPLATE,resource-VirtualCp-template.yml,0,c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscatemplate,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR RequestID=null PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=556f3dd7-c112-43c8-bc5b-104874f26ca0 TargetServiceName=null EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 ErrorCode=500 lock resource with id c586c22c-3c3b-424d-84ce-63033fbaa90a 2021-04-14T11:27:40.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:40.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fb6daa2 2021-04-14T11:27:40.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:40.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:41.280Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter AuditMessage=ACTION = "ArtifactPayloadUpdate" RESOURCE_NAME = "Virtual Cp" RESOURCE_TYPE = "CP" SERVICE_INSTANCE_ID = "d3fccaf0-0201-4ff5-b477-11ddf40aabc4" INVARIANT_UUID = "c897e79d-b2e1-42d8-b754-5547860f5c91" PREV_VERSION = "" CURR_VERSION = "1.0" MODIFIER = "(UNKNOWN)" PREV_STATE = "" CURR_STATE = "CERTIFIED" PREV_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscacsar" CURR_ARTIFACT_UUID = "c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscacsar" ARTIFACT_DATA = "TOSCA,'assettoscacsar',TOSCA_CSAR,resource-VirtualCp-csar.csar,0,c586c22c-3c3b-424d-84ce-63033fbaa90a.assettoscacsar,0 " STATUS = "200" DESC = "OK" SupportablityAction=GENERATE CSAR ResponseCode=201 RequestID=null ElapsedTime=24745 PartnerName=jh0003 auditOn=true SupportablityStatus=COMPLETE ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE TargetEntity=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/upload/multipart?createNewVersion=true ServiceInstanceID=7f9b4321-bb7c-48c9-aea6-601ce3723948 TargetServiceName=null EntryTimestamp=2021-04-14T11:27:16.535Z InvocationID=25c657a2-25e7-4209-a8a0-3adef299b9f3 ErrorCode=500 LogTimestamp=2021-04-14T11:27:41.280066Z ResponseDesc=Created Exiting. 2021-04-14T11:27:41.281Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/upload/multipart HTTP/1.1 SC="201" 2021-04-14T11:27:41.337Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=63a6ec40-966e-474c-a464-3cb34e03b9f4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/uploadType/grouptypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:27:41.337751Z InvocationID=f4cea414-660c-416c-95db-c7a268f59a29 LogTimestamp=2021-04-14T11:27:41.337804Z Entering 2021-04-14T11:27:41.338Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=63a6ec40-966e-474c-a464-3cb34e03b9f4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/uploadType/grouptypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:27:41.337751Z InvocationID=f4cea414-660c-416c-95db-c7a268f59a29 LogTimestamp=2021-04-14T11:27:41.337804Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/grouptypes HTTP/1.1 2021-04-14T11:27:41.364Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : tosca.groups.Root to dao for create 2021-04-14T11:27:41.468Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : org.openecomp.groups.heat.HeatStack to dao for create 2021-04-14T11:27:41.740Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : org.openecomp.groups.VfModule to dao for create 2021-04-14T11:27:42.042Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : org.openecomp.groups.NetworkCollection to dao for create 2021-04-14T11:27:42.157Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : org.openecomp.groups.VfcInstanceGroup to dao for create 2021-04-14T11:27:43.337Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:27:43.337Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:27:43.337Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:43.337Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f57da5a6-9622-4a6c-94ab-b53fa89ede67 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:44.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd1b4e0-5442-45c7-8a25-bd5dca7ce309 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:44.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd1b4e0-5442-45c7-8a25-bd5dca7ce309 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ef8759a 2021-04-14T11:27:44.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd1b4e0-5442-45c7-8a25-bd5dca7ce309 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:44.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efd1b4e0-5442-45c7-8a25-bd5dca7ce309 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:47.038Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : tosca.groups.nfv.PlacementGroup to dao for create 2021-04-14T11:27:47.854Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=efd1b4e0-5442-45c7-8a25-bd5dca7ce309 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:27:47.854Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=efd1b4e0-5442-45c7-8a25-bd5dca7ce309 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:27:49.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c38215bb-a3d9-4448-98c4-d37c494c287b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:27:49.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c38215bb-a3d9-4448-98c4-d37c494c287b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@163ac42b 2021-04-14T11:27:49.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c38215bb-a3d9-4448-98c4-d37c494c287b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:27:49.334Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c38215bb-a3d9-4448-98c4-d37c494c287b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:27:50.250Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c38215bb-a3d9-4448-98c4-d37c494c287b ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:27:50.250Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c38215bb-a3d9-4448-98c4-d37c494c287b ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:28:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:28:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:28:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:28:04.360Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:28:04.360Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:28:04.361Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:28:05.212Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:05.212Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:28:06.213Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:07.214Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:07.791Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : tosca.groups.nfv.NsPlacementGroup to dao for create 2021-04-14T11:28:09.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:15.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:23.735Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.70.81:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:28:23.736Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.70.81:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69) at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282) at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264) at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42) at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:28:23.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:23.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62f99b57 2021-04-14T11:28:23.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:23.736Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:26.825Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:28:26.825Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:28:26.826Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:28:26.826Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0adf6077-3f2a-4609-bbc0-233595b72f90 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:28:27.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:27.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c518023 2021-04-14T11:28:27.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:27.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:30.527Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:28:30.527Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:28:30.528Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:28:30.528Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=8f48d74d-4c1a-4341-971f-e2f096617d70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:28:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:31.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0e40ca-6c36-4ed9-af9f-54a9b105b4d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:31.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0e40ca-6c36-4ed9-af9f-54a9b105b4d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4aa77408 2021-04-14T11:28:31.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0e40ca-6c36-4ed9-af9f-54a9b105b4d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:31.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce0e40ca-6c36-4ed9-af9f-54a9b105b4d4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:33.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:34.265Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ce0e40ca-6c36-4ed9-af9f-54a9b105b4d4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:28:34.265Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ce0e40ca-6c36-4ed9-af9f-54a9b105b4d4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:28:34.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097d7dbc-f091-42df-bad7-c37bdfc5b942 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:34.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097d7dbc-f091-42df-bad7-c37bdfc5b942 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@485bf120 2021-04-14T11:28:34.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097d7dbc-f091-42df-bad7-c37bdfc5b942 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:34.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=097d7dbc-f091-42df-bad7-c37bdfc5b942 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:38.005Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=097d7dbc-f091-42df-bad7-c37bdfc5b942 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:28:38.005Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=097d7dbc-f091-42df-bad7-c37bdfc5b942 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:28:38.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3a31556-45d7-4ee7-8927-fa3070f60f76 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:38.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3a31556-45d7-4ee7-8927-fa3070f60f76 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@221007f0 2021-04-14T11:28:38.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3a31556-45d7-4ee7-8927-fa3070f60f76 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:38.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3a31556-45d7-4ee7-8927-fa3070f60f76 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:40.849Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ed615d81-d540-471f-888c-21b1a161ed93 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:28:40.848708Z InvocationID=caa771e6-0612-4386-b1a7-accfe7d5cf92 LogTimestamp=2021-04-14T11:28:40.848918Z Entering 2021-04-14T11:28:40.850Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ed615d81-d540-471f-888c-21b1a161ed93 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:28:40.848708Z InvocationID=caa771e6-0612-4386-b1a7-accfe7d5cf92 LogTimestamp=2021-04-14T11:28:40.848918Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:28:40.850Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:28:40.850Z InvocationID=db5a5d4b-6024-48a6-908e-8187f7047529 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:28:40.852Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=ves-openapi-manager ElapsedTime=1 EndTimestamp=2021-04-14T11:28:40.851Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.5.13 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:28:40.850Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=db5a5d4b-6024-48a6-908e-8187f7047529 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@33cc8502 2021-04-14T11:28:40.852Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=ves-openapi-manager ElapsedTime=1 EndTimestamp=2021-04-14T11:28:40.851Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.5.13 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:28:40.850Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=db5a5d4b-6024-48a6-908e-8187f7047529 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@33cc8502 2021-04-14T11:28:40.852Z [qtp580718781-16] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:28:40.852495Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:28:40.852Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:28:40.852495Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:28:40.853Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:28:42.113Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b3a31556-45d7-4ee7-8927-fa3070f60f76 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:28:42.114Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b3a31556-45d7-4ee7-8927-fa3070f60f76 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:28:42.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835310b1-4a8b-4564-a933-77d19fa4acd7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:42.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835310b1-4a8b-4564-a933-77d19fa4acd7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24cb4968 2021-04-14T11:28:42.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835310b1-4a8b-4564-a933-77d19fa4acd7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:42.336Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835310b1-4a8b-4564-a933-77d19fa4acd7 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:45.428Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=835310b1-4a8b-4564-a933-77d19fa4acd7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:28:45.429Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=835310b1-4a8b-4564-a933-77d19fa4acd7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:28:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:46.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d1ac9b0-6815-4809-b8b5-e7f989c496e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:46.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d1ac9b0-6815-4809-b8b5-e7f989c496e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6437c0cf 2021-04-14T11:28:46.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d1ac9b0-6815-4809-b8b5-e7f989c496e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:46.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d1ac9b0-6815-4809-b8b5-e7f989c496e6 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:48.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d840c05-79be-4abb-9f1c-0174ada3a9ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:48.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d840c05-79be-4abb-9f1c-0174ada3a9ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a61054f 2021-04-14T11:28:48.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d840c05-79be-4abb-9f1c-0174ada3a9ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:48.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d840c05-79be-4abb-9f1c-0174ada3a9ab PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:48.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:28:49.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a0b2ad-302c-4851-acfb-1f5f7f64e5f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:49.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a0b2ad-302c-4851-acfb-1f5f7f64e5f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fcd3ff4 2021-04-14T11:28:49.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a0b2ad-302c-4851-acfb-1f5f7f64e5f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:49.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33a0b2ad-302c-4851-acfb-1f5f7f64e5f3 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:50.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ccb9ff-674e-4083-85e3-990cfa415b42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:50.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ccb9ff-674e-4083-85e3-990cfa415b42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15a6bf7a 2021-04-14T11:28:50.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ccb9ff-674e-4083-85e3-990cfa415b42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:50.630Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ccb9ff-674e-4083-85e3-990cfa415b42 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:50.724Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send GROUP_TYPE : tosca.groups.nfv.VNFFG to dao for create 2021-04-14T11:28:50.740Z [qtp580718781-18] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m all GroupTypeDataDefinition(uniqueId=tosca.groups.nfv.VNFFG.1.0.grouptype, version=1.0, derivedFrom=tosca.groups.Root, members=[tosca.nodes.nfv.NFP, tosca.nodes.nfv.VNF, tosca.nodes.nfv.NS, tosca.nodes.nfv.NsVirtualLink, tosca.nodes.nfv.NfpPositionElement], metadata=null, description=the VNFFG group type describes a topology of the NS or a portion of the NS, and optionally forwarding rules, applicable to the traffic conveyed over this topology, highestVersion=true, creationTime=1618399730730, modificationTime=1618399730730) [properties=[PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=tosca.groups.nfv.VNFFG.1.0.grouptype.description, type=string, required=true, defaultValue=null, description=Human readable description of the group, schema=null, password=false, name=description, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=null, metadata=null), name=description, constraints=null]]], capabilities={}] were created successfully!!! 2021-04-14T11:28:50.828Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:28:51.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfd97f66-4f85-4955-8ffa-cb7cdf1af877 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:51.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfd97f66-4f85-4955-8ffa-cb7cdf1af877 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4da40713 2021-04-14T11:28:51.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfd97f66-4f85-4955-8ffa-cb7cdf1af877 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:51.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfd97f66-4f85-4955-8ffa-cb7cdf1af877 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:52.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f607de-37e8-4340-9a44-fac79834d3c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:52.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f607de-37e8-4340-9a44-fac79834d3c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fbd2895 2021-04-14T11:28:52.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f607de-37e8-4340-9a44-fac79834d3c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:52.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8f607de-37e8-4340-9a44-fac79834d3c0 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:52.834Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e8f607de-37e8-4340-9a44-fac79834d3c0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:28:52.834Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e8f607de-37e8-4340-9a44-fac79834d3c0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:28:53.431Z [qtp580718781-18] WARN o.o.s.be.servlets.TypesUploadServlet RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m #uploadGroupTypes('{"tosca.groups.Root": {"displayName": "Root", "icon": "group-root"}, "org.openecomp.groups.heat.HeatStack": {"displayName": "Heat Stack", "icon": "group-heat-stack"}, "org.openecomp.groups.VfModule": {"displayName": "VF Module", "icon": "group-vf-module"}, "org.openecomp.groups.NetworkCollection": {"displayName": "Network Collection", "icon": "group-network-collection"}, "org.openecomp.groups.VfcInstanceGroup": {"displayName": "Vfc Instance", "icon": "group-vfc-instance"}, "tosca.groups.nfv.PlacementGroup": {"displayName": "NFV PlacementGroup", "icon": "group-nfv-placementgroup"}, "tosca.groups.nfv.NsPlacementGroup": {"displayName": "NFV NS PlacementGroup", "icon": "group-nfv-placementgroup"}, "tosca.groups.nfv.VNFFG": {"displayName": "NFV VNF Forwarding Graph", "icon": "group-nfv-placementgroup"}}', /tmp/rep11008138481769593241tmp, 'Request(POST https://sdc-be.onap:8443/sdc2/rest/v1/catalog/uploadType/grouptypes)@655eb9d4', 'jh0003'): org.apache.cxf.jaxrs.impl.ResponseImpl@56e5c4b7 in 1.20min (too slow!) 2021-04-14T11:28:53.432Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=72094 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/grouptypes EntryTimestamp=2021-04-14T11:27:41.338Z InvocationID=653a801c-ac5d-4375-91ff-92a324866e54 LogTimestamp=2021-04-14T11:28:53.432107Z ResponseDesc=Created Exiting. 2021-04-14T11:28:53.432Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/grouptypes HTTP/1.1 SC="201" 2021-04-14T11:28:53.520Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cad66739-5e97-45e2-9f92-a5053e0893af InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/uploadType/policytypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:28:53.520677Z InvocationID=4d5ea562-e656-4f7e-a6d3-fb44e5467c7d LogTimestamp=2021-04-14T11:28:53.520739Z Entering 2021-04-14T11:28:53.521Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cad66739-5e97-45e2-9f92-a5053e0893af InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=testName auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.97.12 StatusCode=INPROGRESS userId=jh0003 RemoteHost=10.242.97.12 ServerIPAddress=10.242.62.146 ServiceName=v1/catalog/uploadType/policytypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:28:53.520677Z InvocationID=4d5ea562-e656-4f7e-a6d3-fb44e5467c7d LogTimestamp=2021-04-14T11:28:53.520739Z localAddr=10.242.62.146 remoteAddr=10.242.97.12 POST /sdc2/rest/v1/catalog/uploadType/policytypes HTTP/1.1 2021-04-14T11:28:53.571Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.Root to dao for create 2021-04-14T11:28:53.631Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.Placement to dao for create 2021-04-14T11:28:53.728Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.Scaling to dao for create 2021-04-14T11:28:53.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbd2d583-f2fa-4c32-8cb6-3b9ed604b9be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:53.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbd2d583-f2fa-4c32-8cb6-3b9ed604b9be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39a99609 2021-04-14T11:28:53.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbd2d583-f2fa-4c32-8cb6-3b9ed604b9be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:53.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbd2d583-f2fa-4c32-8cb6-3b9ed604b9be PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:53.816Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.Update to dao for create 2021-04-14T11:28:53.827Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.Performance to dao for create 2021-04-14T11:28:53.837Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.placement.Antilocate to dao for create 2021-04-14T11:28:53.934Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.placement.Colocate to dao for create 2021-04-14T11:28:54.024Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.placement.valet.Diversity to dao for create 2021-04-14T11:28:54.123Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.placement.valet.Exclusivity to dao for create 2021-04-14T11:28:54.218Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.placement.valet.Affinity to dao for create 2021-04-14T11:28:54.375Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.scaling.Fixed to dao for create 2021-04-14T11:28:54.427Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : org.openecomp.policies.External to dao for create 2021-04-14T11:28:54.532Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.InstantiationLevels to dao for create 2021-04-14T11:28:54.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e48d889a-d43c-45f0-b28a-2d58bcf1bdf6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:54.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e48d889a-d43c-45f0-b28a-2d58bcf1bdf6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19d4b329 2021-04-14T11:28:54.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e48d889a-d43c-45f0-b28a-2d58bcf1bdf6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:54.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e48d889a-d43c-45f0-b28a-2d58bcf1bdf6 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:55.700Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VduInstantiationLevels to dao for create 2021-04-14T11:28:55.996Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VirtualLinkInstantiationLevels to dao for create 2021-04-14T11:28:56.093Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.ScalingAspects to dao for create 2021-04-14T11:28:56.202Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VduScalingAspectDeltas to dao for create 2021-04-14T11:28:56.301Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VirtualLinkBitrateScalingAspectDeltas to dao for create 2021-04-14T11:28:56.404Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VduInitialDelta to dao for create 2021-04-14T11:28:56.483Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VirtualLinkBitrateInitialDelta to dao for create 2021-04-14T11:28:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76371309-d7e0-4066-8fc9-6cbdbbac1849 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76371309-d7e0-4066-8fc9-6cbdbbac1849 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74a5a39f 2021-04-14T11:28:57.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76371309-d7e0-4066-8fc9-6cbdbbac1849 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:57.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76371309-d7e0-4066-8fc9-6cbdbbac1849 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:57.289Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.SecurityGroupRule to dao for create 2021-04-14T11:28:57.793Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.SupportedVnfInterface to dao for create 2021-04-14T11:28:57.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff51a390-4c24-4bce-a3f7-1d09c0b1c3ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:57.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff51a390-4c24-4bce-a3f7-1d09c0b1c3ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22ad41e 2021-04-14T11:28:57.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff51a390-4c24-4bce-a3f7-1d09c0b1c3ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:57.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff51a390-4c24-4bce-a3f7-1d09c0b1c3ad PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:59.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512cb528-b421-4f61-8e89-fb91d9f21119 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:59.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512cb528-b421-4f61-8e89-fb91d9f21119 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77c6138c 2021-04-14T11:28:59.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512cb528-b421-4f61-8e89-fb91d9f21119 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:59.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512cb528-b421-4f61-8e89-fb91d9f21119 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:28:59.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0998e48-5875-4693-900b-295b4e4dfab5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:28:59.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0998e48-5875-4693-900b-295b4e4dfab5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bb7bba6 2021-04-14T11:28:59.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0998e48-5875-4693-900b-295b4e4dfab5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:28:59.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0998e48-5875-4693-900b-295b4e4dfab5 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:00.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24689af5-8fb4-44c1-8a93-9016ece181d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:00.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24689af5-8fb4-44c1-8a93-9016ece181d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12574014 2021-04-14T11:29:00.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24689af5-8fb4-44c1-8a93-9016ece181d2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:00.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24689af5-8fb4-44c1-8a93-9016ece181d2 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:00.640Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.AffinityRule to dao for create 2021-04-14T11:29:00.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8bdce6-e760-4639-84ec-6f9d49fae47c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:00.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8bdce6-e760-4639-84ec-6f9d49fae47c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4689fc64 2021-04-14T11:29:00.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8bdce6-e760-4639-84ec-6f9d49fae47c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:00.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8bdce6-e760-4639-84ec-6f9d49fae47c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:01.444Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce19084d-c894-43d6-b638-1b35cdf5bb8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:01.444Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce19084d-c894-43d6-b638-1b35cdf5bb8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@114cd4a 2021-04-14T11:29:01.444Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce19084d-c894-43d6-b638-1b35cdf5bb8c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:01.444Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce19084d-c894-43d6-b638-1b35cdf5bb8c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:01.619Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.AntiAffinityRule to dao for create 2021-04-14T11:29:01.740Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2a971a5-e8aa-49ae-9dba-c43492a30484 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:01.740Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2a971a5-e8aa-49ae-9dba-c43492a30484 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77082c45 2021-04-14T11:29:01.740Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2a971a5-e8aa-49ae-9dba-c43492a30484 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:01.740Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2a971a5-e8aa-49ae-9dba-c43492a30484 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:02.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91611c2c-edc7-4e4e-8cdb-14d33affb441 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:02.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91611c2c-edc7-4e4e-8cdb-14d33affb441 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f779550 2021-04-14T11:29:02.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91611c2c-edc7-4e4e-8cdb-14d33affb441 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:02.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91611c2c-edc7-4e4e-8cdb-14d33affb441 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:02.914Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.NsAffinityRule to dao for create 2021-04-14T11:29:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da64607-f24f-4080-98f5-021c698fee87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da64607-f24f-4080-98f5-021c698fee87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56942806 2021-04-14T11:29:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da64607-f24f-4080-98f5-021c698fee87 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da64607-f24f-4080-98f5-021c698fee87 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:04.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfc61c66-6380-4d6b-8d75-1b057d73ee7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:04.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfc61c66-6380-4d6b-8d75-1b057d73ee7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@714dd103 2021-04-14T11:29:04.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfc61c66-6380-4d6b-8d75-1b057d73ee7f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:04.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfc61c66-6380-4d6b-8d75-1b057d73ee7f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:29:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:29:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:29:04.373Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:29:04.374Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:29:04.374Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:29:04.824Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.NsAntiAffinityRule to dao for create 2021-04-14T11:29:05.118Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.Abstract.SecurityGroupRule to dao for create 2021-04-14T11:29:05.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c4e3af7-24c0-46c4-8d96-aa5b0d492507 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:05.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c4e3af7-24c0-46c4-8d96-aa5b0d492507 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4711b16b 2021-04-14T11:29:05.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c4e3af7-24c0-46c4-8d96-aa5b0d492507 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:05.416Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c4e3af7-24c0-46c4-8d96-aa5b0d492507 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:06.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e71534-0ec9-433b-9596-d83d8c01fe58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:06.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e71534-0ec9-433b-9596-d83d8c01fe58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@242f71cc 2021-04-14T11:29:06.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e71534-0ec9-433b-9596-d83d8c01fe58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:06.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e71534-0ec9-433b-9596-d83d8c01fe58 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:06.813Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.NsSecurityGroupRule to dao for create 2021-04-14T11:29:07.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349a59a3-77a9-454f-b22b-80163a4b4c8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:07.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349a59a3-77a9-454f-b22b-80163a4b4c8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@538ca957 2021-04-14T11:29:07.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349a59a3-77a9-454f-b22b-80163a4b4c8a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:07.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=349a59a3-77a9-454f-b22b-80163a4b4c8a PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:08.511Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.NfpRule to dao for create 2021-04-14T11:29:09.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e109e9b-7dcc-4a25-8e1b-5ae4cc95885e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:09.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e109e9b-7dcc-4a25-8e1b-5ae4cc95885e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c56bfec 2021-04-14T11:29:09.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e109e9b-7dcc-4a25-8e1b-5ae4cc95885e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:09.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e109e9b-7dcc-4a25-8e1b-5ae4cc95885e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:10.515Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.NsMonitoring to dao for create 2021-04-14T11:29:10.832Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m send POLICY_TYPE : tosca.policies.nfv.VnfMonitoring to dao for create 2021-04-14T11:29:10.922Z [qtp580718781-13] INFO o.o.s.b.c.impl.CommonImportManager RequestID=null ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m all PolicyTypeDataDefinition [uniqueId=tosca.policies.nfv.VnfMonitoring.1.0.policytype, type=tosca.policies.nfv.VnfMonitoring, name=NFV VnfMonitoring, icon=policy-nfv-anti-affinityrule, version=1.0, targets=[tosca.nodes.nfv.VNF], metadata=null, description=Policy type is used to identify information to be monitored during the lifetime of a VNF instance as defined in ETSI GS NFV-IFA 014 [2]., creationTime=1618399750910, modificationTime=1618399750910] [ properties=[PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=tosca.policies.nfv.VnfMonitoring.1.0.policytype.vnf_monitoring_parameters, type=list, required=true, defaultValue=null, description=Specifies a virtualised resource related performance metric to be monitored on the NS level., schema=SchemaDefinition [derivedFrom='null, constraints=null, properties=null, property=PropertyDefinition [ PropertyDataDefinition(definition=false, hidden=false, uniqueId=null, type=tosca.datatypes.nfv.VnfMonitoringParameter, required=false, defaultValue=null, description=null, schema=null, password=false, name=null, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=null, metadata=null), name=null, constraints=null]]], password=false, name=vnf_monitoring_parameters, value=null, label=null, immutable=false, mappedToComponentProperty=true, inputPath=null, status=null, inputId=null, instanceUniqueId=null, propertyId=null, parentPropertyType=null, subPropertyInputPath=null, annotations=null, parentUniqueId=null, getInputValues=null, isDeclaredListInput=false, getPolicyValues=null, propertyConstraints=[{"minLength":1}], metadata=null), name=vnf_monitoring_parameters, constraints=[org.openecomp.sdc.be.model.tosca.constraints.MinLengthConstraint@1f61668a]]]] ] were created successfully!!! 2021-04-14T11:29:12.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc580d0c-f92b-438b-bc80-4671f815d204 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:12.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc580d0c-f92b-438b-bc80-4671f815d204 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@606d5e4 2021-04-14T11:29:12.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc580d0c-f92b-438b-bc80-4671f815d204 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:12.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc580d0c-f92b-438b-bc80-4671f815d204 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:12.922Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=201 RequestID=null ElapsedTime=19400 PartnerName=jh0003 auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/catalog/uploadType/policytypes EntryTimestamp=2021-04-14T11:28:53.521Z InvocationID=57d8a2e9-c1fe-4153-bc0f-57cf68c68df8 LogTimestamp=2021-04-14T11:29:12.921461Z ResponseDesc=Created Exiting. 2021-04-14T11:29:12.922Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null POST /sdc2/rest/v1/catalog/uploadType/policytypes HTTP/1.1 SC="201" 2021-04-14T11:29:15.223Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bc580d0c-f92b-438b-bc80-4671f815d204 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:29:15.223Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bc580d0c-f92b-438b-bc80-4671f815d204 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:29:16.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680c0719-aa7d-40fb-998b-42cccc343498 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:16.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680c0719-aa7d-40fb-998b-42cccc343498 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@597865f9 2021-04-14T11:29:16.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680c0719-aa7d-40fb-998b-42cccc343498 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:16.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=680c0719-aa7d-40fb-998b-42cccc343498 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:19.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf03e6e8-bbe6-4475-a77e-b6570f325b28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:19.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf03e6e8-bbe6-4475-a77e-b6570f325b28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16d8d242 2021-04-14T11:29:19.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf03e6e8-bbe6-4475-a77e-b6570f325b28 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:19.049Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf03e6e8-bbe6-4475-a77e-b6570f325b28 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:20.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7efc84-aa18-4702-b39e-89a71eb3d3eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:20.594Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7efc84-aa18-4702-b39e-89a71eb3d3eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26418c88 2021-04-14T11:29:20.594Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7efc84-aa18-4702-b39e-89a71eb3d3eb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:20.594Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7efc84-aa18-4702-b39e-89a71eb3d3eb PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:22.736Z [JanusGraph Cluster-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures 2021-04-14T11:29:22.737Z [JanusGraph Cluster-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.70.81:9042, scheduling retry in 4000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:29:22.835Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures 2021-04-14T11:29:22.836Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 8000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:29:24.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b1eb93-3388-4aab-82d7-45266ecf2894 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:24.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b1eb93-3388-4aab-82d7-45266ecf2894 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c0c7214 2021-04-14T11:29:24.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b1eb93-3388-4aab-82d7-45266ecf2894 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:24.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80b1eb93-3388-4aab-82d7-45266ecf2894 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:27.224Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=80b1eb93-3388-4aab-82d7-45266ecf2894 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:29:27.225Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=80b1eb93-3388-4aab-82d7-45266ecf2894 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:29:27.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b3329c-6a01-4676-9014-162abd59cc06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:27.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b3329c-6a01-4676-9014-162abd59cc06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1662182c 2021-04-14T11:29:27.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b3329c-6a01-4676-9014-162abd59cc06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:27.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92b3329c-6a01-4676-9014-162abd59cc06 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:29.423Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=92b3329c-6a01-4676-9014-162abd59cc06 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:29:29.424Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=92b3329c-6a01-4676-9014-162abd59cc06 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:29:34.928Z [JanusGraph Cluster-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host /10.242.70.81:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:29:34.929Z [JanusGraph Cluster-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to /10.242.70.81:9042, scheduling retry in 8000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.70.81:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:29:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:29:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:29:41.823Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:29:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:29:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:29:47.894Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:29:49.532Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.70.81:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:29:49.533Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.70.81:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69) at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282) at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264) at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42) at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:29:49.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:49.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cf763fb 2021-04-14T11:29:49.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:49.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:29:50.271Z [cluster2-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadFailureException: Operation failed - received 0 responses and 1 failures at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:29:52.540Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:29:52.540Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:29:52.540Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:29:52.541Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6447e8b3-48d8-4754-95c5-61301747a9b8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:29:53.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d058db-24c7-47a2-92a7-3147535773bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:53.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d058db-24c7-47a2-92a7-3147535773bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@333430a3 2021-04-14T11:29:53.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d058db-24c7-47a2-92a7-3147535773bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:53.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77d058db-24c7-47a2-92a7-3147535773bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:29:58.445Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=77d058db-24c7-47a2-92a7-3147535773bb ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:29:58.446Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=77d058db-24c7-47a2-92a7-3147535773bb ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:29:58.905Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b8d91b-40e2-4a65-addd-a2fbcedc4683 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:58.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b8d91b-40e2-4a65-addd-a2fbcedc4683 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37f812d1 2021-04-14T11:29:58.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b8d91b-40e2-4a65-addd-a2fbcedc4683 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:58.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65b8d91b-40e2-4a65-addd-a2fbcedc4683 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:29:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77830354-4623-463d-87cd-91cbf6408c60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:29:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77830354-4623-463d-87cd-91cbf6408c60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6047576e 2021-04-14T11:29:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77830354-4623-463d-87cd-91cbf6408c60 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:29:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77830354-4623-463d-87cd-91cbf6408c60 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:00.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e358ce5-ac20-4eb6-8271-e11de1c927ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:00.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e358ce5-ac20-4eb6-8271-e11de1c927ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72e4d2ed 2021-04-14T11:30:00.151Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e358ce5-ac20-4eb6-8271-e11de1c927ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:00.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e358ce5-ac20-4eb6-8271-e11de1c927ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:01.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62919b9c-2df0-49ad-bf00-c6fb7fadf5b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:01.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62919b9c-2df0-49ad-bf00-c6fb7fadf5b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48a3c455 2021-04-14T11:30:01.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62919b9c-2df0-49ad-bf00-c6fb7fadf5b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:01.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62919b9c-2df0-49ad-bf00-c6fb7fadf5b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:30:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:30:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:30:04.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde7ae15-3c0d-4c32-af7a-79850c99be2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:04.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde7ae15-3c0d-4c32-af7a-79850c99be2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fba290a 2021-04-14T11:30:04.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde7ae15-3c0d-4c32-af7a-79850c99be2c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:04.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde7ae15-3c0d-4c32-af7a-79850c99be2c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:04.730Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:30:04.730Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:30:04.731Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:30:07.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0224770c-96f4-4095-ae7d-6385d6438cde PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:07.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0224770c-96f4-4095-ae7d-6385d6438cde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@659ce5b4 2021-04-14T11:30:07.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0224770c-96f4-4095-ae7d-6385d6438cde PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:07.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0224770c-96f4-4095-ae7d-6385d6438cde PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:10.590Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0224770c-96f4-4095-ae7d-6385d6438cde ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:30:10.591Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0224770c-96f4-4095-ae7d-6385d6438cde ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:30:10.592Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0224770c-96f4-4095-ae7d-6385d6438cde ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:30:10.592Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0224770c-96f4-4095-ae7d-6385d6438cde ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:30:11.410Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7982f4-1f11-44a9-a819-f7ee63f68330 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:11.410Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7982f4-1f11-44a9-a819-f7ee63f68330 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@313b2050 2021-04-14T11:30:11.410Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7982f4-1f11-44a9-a819-f7ee63f68330 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:11.410Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c7982f4-1f11-44a9-a819-f7ee63f68330 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:14.425Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6c7982f4-1f11-44a9-a819-f7ee63f68330 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:30:14.425Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6c7982f4-1f11-44a9-a819-f7ee63f68330 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:30:15.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2bbbd5-2824-449a-80b4-0275c9053f42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:15.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2bbbd5-2824-449a-80b4-0275c9053f42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9f05cd0 2021-04-14T11:30:15.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2bbbd5-2824-449a-80b4-0275c9053f42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:15.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a2bbbd5-2824-449a-80b4-0275c9053f42 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:18.301Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8a2bbbd5-2824-449a-80b4-0275c9053f42 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:30:18.301Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8a2bbbd5-2824-449a-80b4-0275c9053f42 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:30:18.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20c614-56fc-4bac-9742-45179d0f24a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:18.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20c614-56fc-4bac-9742-45179d0f24a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63922197 2021-04-14T11:30:18.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20c614-56fc-4bac-9742-45179d0f24a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:18.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20c614-56fc-4bac-9742-45179d0f24a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:22.724Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5e20c614-56fc-4bac-9742-45179d0f24a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:30:22.725Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5e20c614-56fc-4bac-9742-45179d0f24a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:30:25.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3cf138c-c6a3-4ed9-873f-482d5797e704 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:25.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3cf138c-c6a3-4ed9-873f-482d5797e704 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b8f648 2021-04-14T11:30:25.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3cf138c-c6a3-4ed9-873f-482d5797e704 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:25.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3cf138c-c6a3-4ed9-873f-482d5797e704 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:27.991Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f3cf138c-c6a3-4ed9-873f-482d5797e704 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:30:27.991Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f3cf138c-c6a3-4ed9-873f-482d5797e704 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:30:28.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f619b7b-7389-479d-a6aa-390ff60e98b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:28.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f619b7b-7389-479d-a6aa-390ff60e98b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d4939cb 2021-04-14T11:30:28.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f619b7b-7389-479d-a6aa-390ff60e98b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:28.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f619b7b-7389-479d-a6aa-390ff60e98b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b51c52f-dc89-43e5-a4ec-e36ebc1738fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b51c52f-dc89-43e5-a4ec-e36ebc1738fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46a72d42 2021-04-14T11:30:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b51c52f-dc89-43e5-a4ec-e36ebc1738fc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b51c52f-dc89-43e5-a4ec-e36ebc1738fc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39b0f8e-f979-42a0-8dd2-8f40069232f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39b0f8e-f979-42a0-8dd2-8f40069232f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68039968 2021-04-14T11:30:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39b0f8e-f979-42a0-8dd2-8f40069232f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39b0f8e-f979-42a0-8dd2-8f40069232f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:32.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4758906-2a25-4ee3-85bf-082b9d209137 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:32.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4758906-2a25-4ee3-85bf-082b9d209137 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e7981f0 2021-04-14T11:30:32.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4758906-2a25-4ee3-85bf-082b9d209137 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:32.170Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4758906-2a25-4ee3-85bf-082b9d209137 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:34.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe18ac9-3633-4854-aad0-feb0614e667a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:34.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe18ac9-3633-4854-aad0-feb0614e667a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a3a6095 2021-04-14T11:30:34.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe18ac9-3633-4854-aad0-feb0614e667a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:34.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe18ac9-3633-4854-aad0-feb0614e667a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:36.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0be27e40-c677-4b1d-b8d7-db8b2300ea9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:36.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0be27e40-c677-4b1d-b8d7-db8b2300ea9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5888fad 2021-04-14T11:30:36.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0be27e40-c677-4b1d-b8d7-db8b2300ea9c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:36.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0be27e40-c677-4b1d-b8d7-db8b2300ea9c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:38.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd8cfd35-a973-4bb6-9912-7ee377183b21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:38.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd8cfd35-a973-4bb6-9912-7ee377183b21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71b48ead 2021-04-14T11:30:38.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd8cfd35-a973-4bb6-9912-7ee377183b21 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:38.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd8cfd35-a973-4bb6-9912-7ee377183b21 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecf0e64a-f4fe-4426-9565-f0582f77f4a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecf0e64a-f4fe-4426-9565-f0582f77f4a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@330f76a 2021-04-14T11:30:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecf0e64a-f4fe-4426-9565-f0582f77f4a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:39.647Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecf0e64a-f4fe-4426-9565-f0582f77f4a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:40.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f191753c-6e24-442a-942c-8183c3f58602 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:40.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f191753c-6e24-442a-942c-8183c3f58602 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a271151 2021-04-14T11:30:40.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f191753c-6e24-442a-942c-8183c3f58602 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:40.247Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f191753c-6e24-442a-942c-8183c3f58602 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:42.344Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f14ecb-00d1-4a14-aeb7-4a094dad450d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:42.344Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f14ecb-00d1-4a14-aeb7-4a094dad450d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b13165f 2021-04-14T11:30:42.344Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f14ecb-00d1-4a14-aeb7-4a094dad450d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:42.344Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37f14ecb-00d1-4a14-aeb7-4a094dad450d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:43.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8922c48-032d-46cd-b382-e141189c1b33 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:43.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8922c48-032d-46cd-b382-e141189c1b33 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e073c76 2021-04-14T11:30:43.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8922c48-032d-46cd-b382-e141189c1b33 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:43.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8922c48-032d-46cd-b382-e141189c1b33 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:45.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71853d5d-e841-49f4-9c44-7e8e41d9f10e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:45.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71853d5d-e841-49f4-9c44-7e8e41d9f10e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a88077b 2021-04-14T11:30:45.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71853d5d-e841-49f4-9c44-7e8e41d9f10e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:45.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71853d5d-e841-49f4-9c44-7e8e41d9f10e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:46.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da29e67-1e18-4f56-86d0-61829783f588 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:46.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da29e67-1e18-4f56-86d0-61829783f588 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28b724e2 2021-04-14T11:30:46.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da29e67-1e18-4f56-86d0-61829783f588 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:46.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9da29e67-1e18-4f56-86d0-61829783f588 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:47.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326da1e-00bf-4f77-9bd8-a4aa10719ac2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:47.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326da1e-00bf-4f77-9bd8-a4aa10719ac2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5be56e45 2021-04-14T11:30:47.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326da1e-00bf-4f77-9bd8-a4aa10719ac2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:47.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326da1e-00bf-4f77-9bd8-a4aa10719ac2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:49.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba3bc97f-3f9e-4164-affe-9779f44e7ac4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:49.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba3bc97f-3f9e-4164-affe-9779f44e7ac4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c861dc3 2021-04-14T11:30:49.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba3bc97f-3f9e-4164-affe-9779f44e7ac4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:49.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba3bc97f-3f9e-4164-affe-9779f44e7ac4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:51.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=146bb73f-89e8-4c3d-99c2-7f025569eb09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:51.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=146bb73f-89e8-4c3d-99c2-7f025569eb09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26cf7af7 2021-04-14T11:30:51.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=146bb73f-89e8-4c3d-99c2-7f025569eb09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:51.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=146bb73f-89e8-4c3d-99c2-7f025569eb09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbaa9c29-f87d-42f1-accc-b6b3bc9432b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbaa9c29-f87d-42f1-accc-b6b3bc9432b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37cecaf8 2021-04-14T11:30:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbaa9c29-f87d-42f1-accc-b6b3bc9432b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbaa9c29-f87d-42f1-accc-b6b3bc9432b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:30:57.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ab9c62-8e27-443a-95b9-2def717bc269 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:30:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ab9c62-8e27-443a-95b9-2def717bc269 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47a91d02 2021-04-14T11:30:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ab9c62-8e27-443a-95b9-2def717bc269 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:30:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ab9c62-8e27-443a-95b9-2def717bc269 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:00.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122741c3-58e7-45a7-b2f5-8cded8f5b256 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:00.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122741c3-58e7-45a7-b2f5-8cded8f5b256 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bad6831 2021-04-14T11:31:00.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122741c3-58e7-45a7-b2f5-8cded8f5b256 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:00.340Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122741c3-58e7-45a7-b2f5-8cded8f5b256 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:02.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3acab357-2834-4af5-b4eb-31e3ae378671 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:02.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3acab357-2834-4af5-b4eb-31e3ae378671 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7668a771 2021-04-14T11:31:02.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3acab357-2834-4af5-b4eb-31e3ae378671 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:02.770Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3acab357-2834-4af5-b4eb-31e3ae378671 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:31:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:31:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:31:04.379Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:31:04.379Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:31:04.380Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:31:06.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6e82c45-6c95-4a4c-bc62-951011bc3ff9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:06.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6e82c45-6c95-4a4c-bc62-951011bc3ff9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37b03a4e 2021-04-14T11:31:06.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6e82c45-6c95-4a4c-bc62-951011bc3ff9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:06.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6e82c45-6c95-4a4c-bc62-951011bc3ff9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24c080f6-311a-47e2-afbe-60364aa4cea3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24c080f6-311a-47e2-afbe-60364aa4cea3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@387e70b7 2021-04-14T11:31:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24c080f6-311a-47e2-afbe-60364aa4cea3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24c080f6-311a-47e2-afbe-60364aa4cea3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:12.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea9e55-920e-464d-a377-9eebbc537101 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:12.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea9e55-920e-464d-a377-9eebbc537101 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78526b69 2021-04-14T11:31:12.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea9e55-920e-464d-a377-9eebbc537101 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:12.237Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bea9e55-920e-464d-a377-9eebbc537101 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:15.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4a49ef-8b21-44e0-9014-64c096246e63 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:15.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4a49ef-8b21-44e0-9014-64c096246e63 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b32183d 2021-04-14T11:31:15.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4a49ef-8b21-44e0-9014-64c096246e63 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:15.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4a49ef-8b21-44e0-9014-64c096246e63 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58d7ba41-c6a6-409d-9686-a577d16ada0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58d7ba41-c6a6-409d-9686-a577d16ada0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7de6395f 2021-04-14T11:31:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58d7ba41-c6a6-409d-9686-a577d16ada0f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58d7ba41-c6a6-409d-9686-a577d16ada0f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:21.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dc96848-2c08-4f84-a694-487ada8d8014 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:21.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dc96848-2c08-4f84-a694-487ada8d8014 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3656159c 2021-04-14T11:31:21.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dc96848-2c08-4f84-a694-487ada8d8014 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:21.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dc96848-2c08-4f84-a694-487ada8d8014 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb8a0775-6015-4fe4-9083-22a22f085c15 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb8a0775-6015-4fe4-9083-22a22f085c15 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5db4291c 2021-04-14T11:31:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb8a0775-6015-4fe4-9083-22a22f085c15 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb8a0775-6015-4fe4-9083-22a22f085c15 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:27.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=147b6486-8b33-4704-827b-a4ed1b16bb08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:27.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=147b6486-8b33-4704-827b-a4ed1b16bb08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69c2167 2021-04-14T11:31:27.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=147b6486-8b33-4704-827b-a4ed1b16bb08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:27.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=147b6486-8b33-4704-827b-a4ed1b16bb08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:30.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=792202b6-873b-44f0-9b6f-cfaa25d566b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:30.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=792202b6-873b-44f0-9b6f-cfaa25d566b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a7cdc2a 2021-04-14T11:31:30.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=792202b6-873b-44f0-9b6f-cfaa25d566b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:30.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=792202b6-873b-44f0-9b6f-cfaa25d566b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceac0ff3-5f94-4b84-958a-e4cbaa28979f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceac0ff3-5f94-4b84-958a-e4cbaa28979f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c80da0c 2021-04-14T11:31:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceac0ff3-5f94-4b84-958a-e4cbaa28979f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:33.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceac0ff3-5f94-4b84-958a-e4cbaa28979f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:36.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10466e15-6110-4316-8326-56b7f58f0721 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:36.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10466e15-6110-4316-8326-56b7f58f0721 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3080e649 2021-04-14T11:31:36.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10466e15-6110-4316-8326-56b7f58f0721 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:36.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10466e15-6110-4316-8326-56b7f58f0721 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:39.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68baa97-2775-4c7a-8340-124bee363296 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:39.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68baa97-2775-4c7a-8340-124bee363296 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57707e27 2021-04-14T11:31:39.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68baa97-2775-4c7a-8340-124bee363296 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:39.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e68baa97-2775-4c7a-8340-124bee363296 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:40.257Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Read timed out; blacklisting for 2 minutes 2021-04-14T11:31:40.265Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:31:40.360Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b64a1970-1e71-4525-94fd-59896c0692db InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:31:40.359135Z InvocationID=12eb59ac-c4b5-4ed4-876e-dcd57e01f65f LogTimestamp=2021-04-14T11:31:40.359387Z Entering 2021-04-14T11:31:40.360Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b64a1970-1e71-4525-94fd-59896c0692db InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:31:40.359135Z InvocationID=12eb59ac-c4b5-4ed4-876e-dcd57e01f65f LogTimestamp=2021-04-14T11:31:40.359387Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:31:40.368Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=8 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:31:40.360Z InvocationID=0b47d941-5510-403b-b9b4-583984bb80f5 LogTimestamp=2021-04-14T11:31:40.368481Z ResponseDesc=OK Exiting. 2021-04-14T11:31:40.368Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:31:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1382d25-011a-4fd6-9fa9-dee553f6563d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1382d25-011a-4fd6-9fa9-dee553f6563d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b41756f 2021-04-14T11:31:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1382d25-011a-4fd6-9fa9-dee553f6563d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1382d25-011a-4fd6-9fa9-dee553f6563d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:44.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ca63dc-0811-4a5d-ba5f-ad6406085502 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:44.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ca63dc-0811-4a5d-ba5f-ad6406085502 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@315b90b1 2021-04-14T11:31:44.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ca63dc-0811-4a5d-ba5f-ad6406085502 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:44.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27ca63dc-0811-4a5d-ba5f-ad6406085502 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:48.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31fca5cc-39d9-4395-b401-244aae403690 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:48.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31fca5cc-39d9-4395-b401-244aae403690 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65e8a7d 2021-04-14T11:31:48.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31fca5cc-39d9-4395-b401-244aae403690 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:48.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31fca5cc-39d9-4395-b401-244aae403690 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:51.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd788474-87dc-433d-85a0-e48051185f9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:51.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd788474-87dc-433d-85a0-e48051185f9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@528b5dd7 2021-04-14T11:31:51.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd788474-87dc-433d-85a0-e48051185f9b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:51.166Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd788474-87dc-433d-85a0-e48051185f9b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:53.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4dd3ef-059f-4f58-9511-a98eb9ea97f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:53.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4dd3ef-059f-4f58-9511-a98eb9ea97f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2211a0e4 2021-04-14T11:31:53.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4dd3ef-059f-4f58-9511-a98eb9ea97f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:53.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4dd3ef-059f-4f58-9511-a98eb9ea97f1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccc106c7-a8b6-4f12-b0db-59c08a254b1c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccc106c7-a8b6-4f12-b0db-59c08a254b1c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35b0936d 2021-04-14T11:31:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccc106c7-a8b6-4f12-b0db-59c08a254b1c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccc106c7-a8b6-4f12-b0db-59c08a254b1c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:31:59.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd7cdc90-1385-4351-913a-fe97950ec7ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:31:59.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd7cdc90-1385-4351-913a-fe97950ec7ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a8913bf 2021-04-14T11:31:59.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd7cdc90-1385-4351-913a-fe97950ec7ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:31:59.771Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd7cdc90-1385-4351-913a-fe97950ec7ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:03.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d9da988-5720-4289-9956-ae69769e27e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:03.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d9da988-5720-4289-9956-ae69769e27e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4667b8eb 2021-04-14T11:32:03.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d9da988-5720-4289-9956-ae69769e27e8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:03.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d9da988-5720-4289-9956-ae69769e27e8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:32:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:32:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:32:04.359Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:32:04.360Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:32:04.360Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:32:06.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=135cf2a4-11ba-4e6c-b9fa-e157e170bb43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:06.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=135cf2a4-11ba-4e6c-b9fa-e157e170bb43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1348ee67 2021-04-14T11:32:06.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=135cf2a4-11ba-4e6c-b9fa-e157e170bb43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:06.347Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=135cf2a4-11ba-4e6c-b9fa-e157e170bb43 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:08.855Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d53a0746-11ea-43d5-9256-c35bfce94486 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:32:08.854393Z InvocationID=36e5d616-6dc0-45e4-b5ed-cd6afc9e4f28 LogTimestamp=2021-04-14T11:32:08.854643Z Entering 2021-04-14T11:32:08.855Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d53a0746-11ea-43d5-9256-c35bfce94486 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:32:08.854393Z InvocationID=36e5d616-6dc0-45e4-b5ed-cd6afc9e4f28 LogTimestamp=2021-04-14T11:32:08.854643Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:32:08.859Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:32:08.856Z InvocationID=d9468759-c9d1-4f54-ab3e-82c0a8ec0d1c LogTimestamp=2021-04-14T11:32:08.859520Z ResponseDesc=OK Exiting. 2021-04-14T11:32:08.859Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:32:09.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc5ff0e-ea7d-4890-b76c-1f7d3417b097 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:09.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc5ff0e-ea7d-4890-b76c-1f7d3417b097 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22523c98 2021-04-14T11:32:09.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc5ff0e-ea7d-4890-b76c-1f7d3417b097 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:09.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdc5ff0e-ea7d-4890-b76c-1f7d3417b097 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:12.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0d5a0a5-748c-45ec-8eb7-fe4ab6fc492d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:12.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0d5a0a5-748c-45ec-8eb7-fe4ab6fc492d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7094c786 2021-04-14T11:32:12.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0d5a0a5-748c-45ec-8eb7-fe4ab6fc492d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:12.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0d5a0a5-748c-45ec-8eb7-fe4ab6fc492d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:15.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803abd7c-5f2b-48c4-ad22-b2af2aa6d221 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:15.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803abd7c-5f2b-48c4-ad22-b2af2aa6d221 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bcf999f 2021-04-14T11:32:15.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803abd7c-5f2b-48c4-ad22-b2af2aa6d221 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:15.249Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=803abd7c-5f2b-48c4-ad22-b2af2aa6d221 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:17.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dcf3023-5447-4d3d-84ff-9cfcca425b99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:17.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dcf3023-5447-4d3d-84ff-9cfcca425b99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fa07557 2021-04-14T11:32:17.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dcf3023-5447-4d3d-84ff-9cfcca425b99 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:17.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dcf3023-5447-4d3d-84ff-9cfcca425b99 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:20.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dfc54-432d-49a7-8575-9e7ac414afef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:20.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dfc54-432d-49a7-8575-9e7ac414afef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ca534c7 2021-04-14T11:32:20.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dfc54-432d-49a7-8575-9e7ac414afef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:20.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=330dfc54-432d-49a7-8575-9e7ac414afef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:24.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=976e30f4-bd77-4951-ae3c-d0e023f2f0fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:24.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=976e30f4-bd77-4951-ae3c-d0e023f2f0fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a5b7622 2021-04-14T11:32:24.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=976e30f4-bd77-4951-ae3c-d0e023f2f0fb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:24.155Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=976e30f4-bd77-4951-ae3c-d0e023f2f0fb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:27.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cd0d95-973b-404a-81c2-7ddf0be70eda PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:27.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cd0d95-973b-404a-81c2-7ddf0be70eda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d2f0397 2021-04-14T11:32:27.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cd0d95-973b-404a-81c2-7ddf0be70eda PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:27.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cd0d95-973b-404a-81c2-7ddf0be70eda PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3212d05d-a918-406e-bcb9-523a8f7a65e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3212d05d-a918-406e-bcb9-523a8f7a65e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1179dda8 2021-04-14T11:32:30.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3212d05d-a918-406e-bcb9-523a8f7a65e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:30.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3212d05d-a918-406e-bcb9-523a8f7a65e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:33.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d8567-be2d-4a7c-8b92-74a042b3a632 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:33.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d8567-be2d-4a7c-8b92-74a042b3a632 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54bfc04c 2021-04-14T11:32:33.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d8567-be2d-4a7c-8b92-74a042b3a632 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:33.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b9d8567-be2d-4a7c-8b92-74a042b3a632 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:35.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555fdf32-ec60-4228-b5d6-b0ea12e95f17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:35.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555fdf32-ec60-4228-b5d6-b0ea12e95f17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3534469f 2021-04-14T11:32:35.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555fdf32-ec60-4228-b5d6-b0ea12e95f17 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:35.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555fdf32-ec60-4228-b5d6-b0ea12e95f17 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:38.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f110b1-6a68-4e72-8e32-f3f703af706d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:38.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f110b1-6a68-4e72-8e32-f3f703af706d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b2c815 2021-04-14T11:32:38.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f110b1-6a68-4e72-8e32-f3f703af706d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:38.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08f110b1-6a68-4e72-8e32-f3f703af706d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:42.362Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2948139-82ee-4f62-b2ea-18e49b438c24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:42.362Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2948139-82ee-4f62-b2ea-18e49b438c24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f79d136 2021-04-14T11:32:42.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2948139-82ee-4f62-b2ea-18e49b438c24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:42.363Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2948139-82ee-4f62-b2ea-18e49b438c24 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39d544e-ba36-474c-8fe0-24b75b450fd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39d544e-ba36-474c-8fe0-24b75b450fd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@756ed735 2021-04-14T11:32:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39d544e-ba36-474c-8fe0-24b75b450fd5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d39d544e-ba36-474c-8fe0-24b75b450fd5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:47.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66b50f2-b589-4e08-9986-565fdacf4428 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66b50f2-b589-4e08-9986-565fdacf4428 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62f967b9 2021-04-14T11:32:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66b50f2-b589-4e08-9986-565fdacf4428 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e66b50f2-b589-4e08-9986-565fdacf4428 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:50.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd56bf7-74c8-406c-98d5-67c7a5416663 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:50.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd56bf7-74c8-406c-98d5-67c7a5416663 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@741de993 2021-04-14T11:32:50.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd56bf7-74c8-406c-98d5-67c7a5416663 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:50.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcd56bf7-74c8-406c-98d5-67c7a5416663 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02436e70-283d-4ddc-a520-78a24ee8773f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02436e70-283d-4ddc-a520-78a24ee8773f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65fc6647 2021-04-14T11:32:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02436e70-283d-4ddc-a520-78a24ee8773f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02436e70-283d-4ddc-a520-78a24ee8773f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:32:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e31f84-0546-49ed-8d5f-f2fe121d6e1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:32:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e31f84-0546-49ed-8d5f-f2fe121d6e1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6628d2b2 2021-04-14T11:32:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e31f84-0546-49ed-8d5f-f2fe121d6e1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:32:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e31f84-0546-49ed-8d5f-f2fe121d6e1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:00.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:33:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:33:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:33:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:33:04.388Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:33:04.389Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:33:04.389Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:33:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:09.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:18.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:19.435Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.70.81:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:33:19.435Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.70.81:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69) at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282) at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264) at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42) at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:33:19.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cd1b276-805f-478c-8543-597fa241057b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:19.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cd1b276-805f-478c-8543-597fa241057b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fc5a561 2021-04-14T11:33:19.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cd1b276-805f-478c-8543-597fa241057b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:19.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cd1b276-805f-478c-8543-597fa241057b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:33:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:22.445Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3cd1b276-805f-478c-8543-597fa241057b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:33:22.446Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3cd1b276-805f-478c-8543-597fa241057b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:33:22.447Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3cd1b276-805f-478c-8543-597fa241057b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:22.447Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3cd1b276-805f-478c-8543-597fa241057b ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@548f9c7b 2021-04-14T11:33:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:33:24.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:26.237Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:33:26.237Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:33:26.237Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:26.237Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=2b087616-1b70-4d6f-b24d-9c443698a380 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:33:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3fc32b3-8b48-4378-b371-19ef52f99b26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3fc32b3-8b48-4378-b371-19ef52f99b26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@725af34b 2021-04-14T11:33:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3fc32b3-8b48-4378-b371-19ef52f99b26 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3fc32b3-8b48-4378-b371-19ef52f99b26 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:33:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:30.246Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a3fc32b3-8b48-4378-b371-19ef52f99b26 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:30.246Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=a3fc32b3-8b48-4378-b371-19ef52f99b26 ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:33:30.611Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:33:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:33:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:33:36.184Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:33:39.592Z [cluster1-nio-worker-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:33:39.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:39.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@389284f9 2021-04-14T11:33:39.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:39.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:33:42.599Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:33:42.599Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:33:42.599Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:42.599Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=cf2afd7d-aa56-47cd-aca6-29a2b85b4863 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:33:43.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9cc0d95-cca2-468e-8d76-a5a1cf2642f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:43.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9cc0d95-cca2-468e-8d76-a5a1cf2642f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5288fd96 2021-04-14T11:33:43.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9cc0d95-cca2-468e-8d76-a5a1cf2642f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:43.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9cc0d95-cca2-468e-8d76-a5a1cf2642f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:44.553Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b9cc0d95-cca2-468e-8d76-a5a1cf2642f0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:44.553Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=b9cc0d95-cca2-468e-8d76-a5a1cf2642f0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:45.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79560b3e-d63c-4304-9e45-b2340d4d157c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:45.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79560b3e-d63c-4304-9e45-b2340d4d157c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5268fcc8 2021-04-14T11:33:45.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79560b3e-d63c-4304-9e45-b2340d4d157c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:45.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79560b3e-d63c-4304-9e45-b2340d4d157c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:47.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fe5a1a-a35f-4ffe-9351-6065f381e0d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:47.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fe5a1a-a35f-4ffe-9351-6065f381e0d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e710f30 2021-04-14T11:33:47.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fe5a1a-a35f-4ffe-9351-6065f381e0d2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:47.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fe5a1a-a35f-4ffe-9351-6065f381e0d2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:49.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3504a398-3a06-40a1-b5bc-49246aeded9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:49.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3504a398-3a06-40a1-b5bc-49246aeded9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b803925 2021-04-14T11:33:49.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3504a398-3a06-40a1-b5bc-49246aeded9d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:49.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3504a398-3a06-40a1-b5bc-49246aeded9d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:50.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efee418-e0dd-4769-b507-c83a432281fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:50.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efee418-e0dd-4769-b507-c83a432281fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70170cc6 2021-04-14T11:33:50.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efee418-e0dd-4769-b507-c83a432281fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:50.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efee418-e0dd-4769-b507-c83a432281fe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:51.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6714fed-af35-4a3d-8db2-74d435f47176 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:51.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6714fed-af35-4a3d-8db2-74d435f47176 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@658c30b0 2021-04-14T11:33:51.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6714fed-af35-4a3d-8db2-74d435f47176 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:51.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6714fed-af35-4a3d-8db2-74d435f47176 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:52.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e2ea63-bd77-4aa7-ac0f-1b30d59aedc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:52.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e2ea63-bd77-4aa7-ac0f-1b30d59aedc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13f2bbbe 2021-04-14T11:33:52.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e2ea63-bd77-4aa7-ac0f-1b30d59aedc1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:52.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e2ea63-bd77-4aa7-ac0f-1b30d59aedc1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52035f5a-eeb9-47b8-b919-ce172d766195 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52035f5a-eeb9-47b8-b919-ce172d766195 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79d1e1f4 2021-04-14T11:33:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52035f5a-eeb9-47b8-b919-ce172d766195 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:54.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52035f5a-eeb9-47b8-b919-ce172d766195 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:55.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:55.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3168a334 2021-04-14T11:33:55.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:55.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:33:58.517Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:33:58.517Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:33:58.517Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:58.517Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ec41ae8c-a8f5-4ec7-9051-ccf8df5a43a5 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:33:58.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fce83172-7659-4d55-878b-00fc67792bc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:33:58.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fce83172-7659-4d55-878b-00fc67792bc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35650c19 2021-04-14T11:33:58.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fce83172-7659-4d55-878b-00fc67792bc1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:33:58.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fce83172-7659-4d55-878b-00fc67792bc1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:01.836Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fce83172-7659-4d55-878b-00fc67792bc1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:01.837Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fce83172-7659-4d55-878b-00fc67792bc1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:02.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83bc7ef0-aa3c-4dfd-a44b-3ab397888579 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:02.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83bc7ef0-aa3c-4dfd-a44b-3ab397888579 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45e4e78c 2021-04-14T11:34:02.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83bc7ef0-aa3c-4dfd-a44b-3ab397888579 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:02.742Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83bc7ef0-aa3c-4dfd-a44b-3ab397888579 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:34:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:34:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:34:05.754Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=83bc7ef0-aa3c-4dfd-a44b-3ab397888579 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:05.754Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=83bc7ef0-aa3c-4dfd-a44b-3ab397888579 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:06.568Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:34:06.569Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:34:06.569Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:34:07.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df6f9ea-6fd2-454a-b096-eb5d3baeb0d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:07.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df6f9ea-6fd2-454a-b096-eb5d3baeb0d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cf94af6 2021-04-14T11:34:07.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df6f9ea-6fd2-454a-b096-eb5d3baeb0d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:07.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3df6f9ea-6fd2-454a-b096-eb5d3baeb0d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:08.990Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3df6f9ea-6fd2-454a-b096-eb5d3baeb0d7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:34:08.990Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3df6f9ea-6fd2-454a-b096-eb5d3baeb0d7 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:34:09.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd307e41-4dd9-44cc-ad64-e4d49cad91b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:09.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd307e41-4dd9-44cc-ad64-e4d49cad91b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ead5fce 2021-04-14T11:34:09.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd307e41-4dd9-44cc-ad64-e4d49cad91b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:09.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd307e41-4dd9-44cc-ad64-e4d49cad91b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:12.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05579e2b-357f-476b-9334-215def0ebf1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:12.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05579e2b-357f-476b-9334-215def0ebf1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2399e0a9 2021-04-14T11:34:12.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05579e2b-357f-476b-9334-215def0ebf1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:12.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05579e2b-357f-476b-9334-215def0ebf1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:13.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c54282ab-6119-4423-b20c-16ac4908b641 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:13.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c54282ab-6119-4423-b20c-16ac4908b641 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4551b0d6 2021-04-14T11:34:13.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c54282ab-6119-4423-b20c-16ac4908b641 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:13.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c54282ab-6119-4423-b20c-16ac4908b641 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:14.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460eef7-a462-4919-9857-6bc59f94ee69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:14.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460eef7-a462-4919-9857-6bc59f94ee69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@178728c 2021-04-14T11:34:14.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460eef7-a462-4919-9857-6bc59f94ee69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:14.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a460eef7-a462-4919-9857-6bc59f94ee69 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:15.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=819bd2cf-4b72-4f8f-9619-b819db22a465 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:15.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=819bd2cf-4b72-4f8f-9619-b819db22a465 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@755f0e42 2021-04-14T11:34:15.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=819bd2cf-4b72-4f8f-9619-b819db22a465 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:15.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=819bd2cf-4b72-4f8f-9619-b819db22a465 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:16.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed23f6a-a3af-403d-893c-3efd824dfdf6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:16.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed23f6a-a3af-403d-893c-3efd824dfdf6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@192f34e8 2021-04-14T11:34:16.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed23f6a-a3af-403d-893c-3efd824dfdf6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:16.739Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed23f6a-a3af-403d-893c-3efd824dfdf6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:17.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e09ccb4e-ae2f-47f8-a251-24823a144fe4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:17.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e09ccb4e-ae2f-47f8-a251-24823a144fe4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5130f01b 2021-04-14T11:34:17.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e09ccb4e-ae2f-47f8-a251-24823a144fe4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:17.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e09ccb4e-ae2f-47f8-a251-24823a144fe4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:18.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c219791d-6cc1-4a6e-a8f5-d62f29788cab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:18.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c219791d-6cc1-4a6e-a8f5-d62f29788cab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@131e04a3 2021-04-14T11:34:18.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c219791d-6cc1-4a6e-a8f5-d62f29788cab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:18.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c219791d-6cc1-4a6e-a8f5-d62f29788cab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:19.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2e4496-f462-406f-be49-a5aef3fc31a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:19.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2e4496-f462-406f-be49-a5aef3fc31a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ebe259c 2021-04-14T11:34:19.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2e4496-f462-406f-be49-a5aef3fc31a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:19.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf2e4496-f462-406f-be49-a5aef3fc31a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:20.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9b5c421-d9cd-40a9-8f62-16b07731817a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:20.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9b5c421-d9cd-40a9-8f62-16b07731817a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ed6dad7 2021-04-14T11:34:20.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9b5c421-d9cd-40a9-8f62-16b07731817a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:20.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9b5c421-d9cd-40a9-8f62-16b07731817a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:21.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38971280-da2b-455b-907c-39e38ba70426 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:21.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38971280-da2b-455b-907c-39e38ba70426 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28b05d3e 2021-04-14T11:34:21.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38971280-da2b-455b-907c-39e38ba70426 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:21.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38971280-da2b-455b-907c-39e38ba70426 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4be87f97 2021-04-14T11:34:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:23.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:26.231Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:34:26.231Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:34:26.232Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:34:26.232Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=da48062f-6355-4dc1-8838-7cc9185c8fa9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:34:27.289Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2833-e827-40f7-b3f9-1de49c2b834e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:27.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2833-e827-40f7-b3f9-1de49c2b834e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@249521b3 2021-04-14T11:34:27.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2833-e827-40f7-b3f9-1de49c2b834e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:27.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=714b2833-e827-40f7-b3f9-1de49c2b834e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:30.307Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=714b2833-e827-40f7-b3f9-1de49c2b834e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:30.307Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=714b2833-e827-40f7-b3f9-1de49c2b834e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:31.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec6a4d00-e2b6-4280-8395-f38cbb3e6224 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:31.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec6a4d00-e2b6-4280-8395-f38cbb3e6224 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@462ebe9c 2021-04-14T11:34:31.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec6a4d00-e2b6-4280-8395-f38cbb3e6224 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:31.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec6a4d00-e2b6-4280-8395-f38cbb3e6224 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:34.126Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ec6a4d00-e2b6-4280-8395-f38cbb3e6224 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:34.126Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ec6a4d00-e2b6-4280-8395-f38cbb3e6224 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e8cae-b57b-4bed-9d25-d1391e618987 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e8cae-b57b-4bed-9d25-d1391e618987 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43a74dc5 2021-04-14T11:34:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e8cae-b57b-4bed-9d25-d1391e618987 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=323e8cae-b57b-4bed-9d25-d1391e618987 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:37.548Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=323e8cae-b57b-4bed-9d25-d1391e618987 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:37.549Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=323e8cae-b57b-4bed-9d25-d1391e618987 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:38.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2108e69f-a35f-4343-884d-b77e677f5ac2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:38.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2108e69f-a35f-4343-884d-b77e677f5ac2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76295fa8 2021-04-14T11:34:38.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2108e69f-a35f-4343-884d-b77e677f5ac2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:38.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2108e69f-a35f-4343-884d-b77e677f5ac2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:43.970Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2108e69f-a35f-4343-884d-b77e677f5ac2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:34:43.971Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2108e69f-a35f-4343-884d-b77e677f5ac2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:34:44.744Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02d5361-96df-42c2-99c1-4cff1642740b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:44.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02d5361-96df-42c2-99c1-4cff1642740b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@525edf94 2021-04-14T11:34:44.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02d5361-96df-42c2-99c1-4cff1642740b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:44.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a02d5361-96df-42c2-99c1-4cff1642740b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:47.756Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a02d5361-96df-42c2-99c1-4cff1642740b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:47.757Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a02d5361-96df-42c2-99c1-4cff1642740b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:49.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da757498-f2f0-4204-ac4d-51459adcfbf4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:49.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da757498-f2f0-4204-ac4d-51459adcfbf4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dab01d1 2021-04-14T11:34:49.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da757498-f2f0-4204-ac4d-51459adcfbf4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:49.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da757498-f2f0-4204-ac4d-51459adcfbf4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:52.042Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=da757498-f2f0-4204-ac4d-51459adcfbf4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:52.043Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=da757498-f2f0-4204-ac4d-51459adcfbf4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:52.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c43d23c7-7fd8-4cf4-b374-afb1538d8bf8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:52.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c43d23c7-7fd8-4cf4-b374-afb1538d8bf8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5129355d 2021-04-14T11:34:52.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c43d23c7-7fd8-4cf4-b374-afb1538d8bf8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:52.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c43d23c7-7fd8-4cf4-b374-afb1538d8bf8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:55.933Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c43d23c7-7fd8-4cf4-b374-afb1538d8bf8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:34:55.933Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c43d23c7-7fd8-4cf4-b374-afb1538d8bf8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:34:56.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bc70011-c20a-4a1a-9f72-33a64ecf97eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:56.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bc70011-c20a-4a1a-9f72-33a64ecf97eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b772102 2021-04-14T11:34:56.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bc70011-c20a-4a1a-9f72-33a64ecf97eb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:56.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bc70011-c20a-4a1a-9f72-33a64ecf97eb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:34:58.593Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7bc70011-c20a-4a1a-9f72-33a64ecf97eb ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:34:58.594Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7bc70011-c20a-4a1a-9f72-33a64ecf97eb ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:34:59.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170e1c0a-f50a-42b0-9a85-209d7eb1c5c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:34:59.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170e1c0a-f50a-42b0-9a85-209d7eb1c5c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39791f2d 2021-04-14T11:34:59.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170e1c0a-f50a-42b0-9a85-209d7eb1c5c3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:34:59.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=170e1c0a-f50a-42b0-9a85-209d7eb1c5c3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:01.448Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938bc3d3-4fab-4799-b27a-8b3611539cff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:01.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938bc3d3-4fab-4799-b27a-8b3611539cff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f0c6d7a 2021-04-14T11:35:01.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938bc3d3-4fab-4799-b27a-8b3611539cff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:01.449Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938bc3d3-4fab-4799-b27a-8b3611539cff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:02.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4df2f01-231e-4e6e-945d-ea77b5a7ae9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:02.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4df2f01-231e-4e6e-945d-ea77b5a7ae9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4de138a8 2021-04-14T11:35:02.436Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4df2f01-231e-4e6e-945d-ea77b5a7ae9f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:02.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4df2f01-231e-4e6e-945d-ea77b5a7ae9f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:03.232Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a8ebb2-b88d-4d18-92d4-6ad761176e3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:03.232Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a8ebb2-b88d-4d18-92d4-6ad761176e3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e1c3248 2021-04-14T11:35:03.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a8ebb2-b88d-4d18-92d4-6ad761176e3e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:03.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47a8ebb2-b88d-4d18-92d4-6ad761176e3e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:35:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:35:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:35:04.432Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:35:04.433Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:35:04.433Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:35:04.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e845f514-4a5f-479d-96a8-18dda6ad2204 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:04.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e845f514-4a5f-479d-96a8-18dda6ad2204 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f6dcad1 2021-04-14T11:35:04.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e845f514-4a5f-479d-96a8-18dda6ad2204 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:04.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e845f514-4a5f-479d-96a8-18dda6ad2204 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:05.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652f23b3-e7ba-4246-8167-0013782383f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:05.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652f23b3-e7ba-4246-8167-0013782383f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33b601fb 2021-04-14T11:35:05.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652f23b3-e7ba-4246-8167-0013782383f5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:05.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=652f23b3-e7ba-4246-8167-0013782383f5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64835e91-1a96-4270-9169-da9e106cbe05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64835e91-1a96-4270-9169-da9e106cbe05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77d65b5d 2021-04-14T11:35:07.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64835e91-1a96-4270-9169-da9e106cbe05 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:07.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64835e91-1a96-4270-9169-da9e106cbe05 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9371e03a-0e0b-4e81-b39c-5888f169e3e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9371e03a-0e0b-4e81-b39c-5888f169e3e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68c7a99d 2021-04-14T11:35:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9371e03a-0e0b-4e81-b39c-5888f169e3e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9371e03a-0e0b-4e81-b39c-5888f169e3e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45bd8686-c4c1-40ca-8496-b883aa05efd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45bd8686-c4c1-40ca-8496-b883aa05efd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@91dcd16 2021-04-14T11:35:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45bd8686-c4c1-40ca-8496-b883aa05efd9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45bd8686-c4c1-40ca-8496-b883aa05efd9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:14.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:14.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a27ac17 2021-04-14T11:35:14.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:14.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:17.779Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:35:17.780Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:35:17.780Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:17.780Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0886f7ee-d924-463a-9776-4b0dfa1e2e36 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:18.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=715c371d-a8fd-49de-9b85-cb8d215c43f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:18.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=715c371d-a8fd-49de-9b85-cb8d215c43f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fee02bd 2021-04-14T11:35:18.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=715c371d-a8fd-49de-9b85-cb8d215c43f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:18.863Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=715c371d-a8fd-49de-9b85-cb8d215c43f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:20.365Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=715c371d-a8fd-49de-9b85-cb8d215c43f2 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:20.365Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=715c371d-a8fd-49de-9b85-cb8d215c43f2 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:21.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48ad25ef-dcaf-4567-87e1-d14d495be328 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:21.374Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48ad25ef-dcaf-4567-87e1-d14d495be328 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d22daa1 2021-04-14T11:35:21.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48ad25ef-dcaf-4567-87e1-d14d495be328 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:21.375Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48ad25ef-dcaf-4567-87e1-d14d495be328 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:24.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efc0b80-6ff6-40af-996e-140721968520 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:24.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efc0b80-6ff6-40af-996e-140721968520 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ad28606 2021-04-14T11:35:24.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efc0b80-6ff6-40af-996e-140721968520 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:24.437Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2efc0b80-6ff6-40af-996e-140721968520 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:27.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cf7df7c-537b-45e0-b6dc-7c33efac9a25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:27.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cf7df7c-537b-45e0-b6dc-7c33efac9a25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75168e0b 2021-04-14T11:35:27.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cf7df7c-537b-45e0-b6dc-7c33efac9a25 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:27.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cf7df7c-537b-45e0-b6dc-7c33efac9a25 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:30.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=464adcdb-aa6a-41da-b792-949c92264eef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:30.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=464adcdb-aa6a-41da-b792-949c92264eef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b60d14 2021-04-14T11:35:30.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=464adcdb-aa6a-41da-b792-949c92264eef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:30.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=464adcdb-aa6a-41da-b792-949c92264eef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ea059a-c404-4d02-ae9f-288af75a9151 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ea059a-c404-4d02-ae9f-288af75a9151 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22a3551 2021-04-14T11:35:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ea059a-c404-4d02-ae9f-288af75a9151 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:33.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ea059a-c404-4d02-ae9f-288af75a9151 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:36.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de2475f9-a587-4d01-8ee8-ddb8bbf3bfe2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:36.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de2475f9-a587-4d01-8ee8-ddb8bbf3bfe2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c9671a4 2021-04-14T11:35:36.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de2475f9-a587-4d01-8ee8-ddb8bbf3bfe2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:36.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de2475f9-a587-4d01-8ee8-ddb8bbf3bfe2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:39.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049cd47a-bf45-451b-85ea-c7d8f7de4fb8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:39.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049cd47a-bf45-451b-85ea-c7d8f7de4fb8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1db1daeb 2021-04-14T11:35:39.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049cd47a-bf45-451b-85ea-c7d8f7de4fb8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:39.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=049cd47a-bf45-451b-85ea-c7d8f7de4fb8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:41.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56348916-b272-4ba0-847a-dc38897164fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:41.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56348916-b272-4ba0-847a-dc38897164fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4436bae4 2021-04-14T11:35:41.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56348916-b272-4ba0-847a-dc38897164fd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:41.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56348916-b272-4ba0-847a-dc38897164fd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:45.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd92bdb2-fa95-400a-9114-788b8b1ee978 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:45.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd92bdb2-fa95-400a-9114-788b8b1ee978 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17659f8e 2021-04-14T11:35:45.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd92bdb2-fa95-400a-9114-788b8b1ee978 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:45.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd92bdb2-fa95-400a-9114-788b8b1ee978 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:48.365Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc81873b-b337-445e-94fc-0bfebeee9679 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:48.365Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc81873b-b337-445e-94fc-0bfebeee9679 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7811d797 2021-04-14T11:35:48.365Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc81873b-b337-445e-94fc-0bfebeee9679 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:48.365Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc81873b-b337-445e-94fc-0bfebeee9679 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:51.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:51.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b643cfc 2021-04-14T11:35:51.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:51.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:54.231Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:35:54.231Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:35:54.232Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:54.232Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=995d2b0d-6fbb-4e10-a141-8ee35cb37a05 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:54.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec96477a-4cfd-4544-953c-f6fdc89a6f70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:54.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec96477a-4cfd-4544-953c-f6fdc89a6f70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1af44aee 2021-04-14T11:35:54.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec96477a-4cfd-4544-953c-f6fdc89a6f70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:54.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec96477a-4cfd-4544-953c-f6fdc89a6f70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:57.574Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ec96477a-4cfd-4544-953c-f6fdc89a6f70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:35:57.574Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ec96477a-4cfd-4544-953c-f6fdc89a6f70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:35:58.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835f2835-b7ad-41cb-965b-26582cf2b545 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:58.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835f2835-b7ad-41cb-965b-26582cf2b545 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@570df903 2021-04-14T11:35:58.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835f2835-b7ad-41cb-965b-26582cf2b545 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:58.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=835f2835-b7ad-41cb-965b-26582cf2b545 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:35:58.918Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=835f2835-b7ad-41cb-965b-26582cf2b545 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:58.918Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=835f2835-b7ad-41cb-965b-26582cf2b545 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:35:59.640Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=282dc90c-e4a0-4a03-b021-9be0c3baf93f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:35:59.640Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=282dc90c-e4a0-4a03-b021-9be0c3baf93f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25df36ae 2021-04-14T11:35:59.640Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=282dc90c-e4a0-4a03-b021-9be0c3baf93f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:35:59.640Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=282dc90c-e4a0-4a03-b021-9be0c3baf93f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64ffd83a-fb73-4aa9-b5b0-3e47fe4a5991 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64ffd83a-fb73-4aa9-b5b0-3e47fe4a5991 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35e72d73 2021-04-14T11:36:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64ffd83a-fb73-4aa9-b5b0-3e47fe4a5991 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=64ffd83a-fb73-4aa9-b5b0-3e47fe4a5991 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:36:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:36:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:36:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bed92f-9c24-4ba6-b589-9a729a8a4870 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bed92f-9c24-4ba6-b589-9a729a8a4870 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d9a1f2d 2021-04-14T11:36:05.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bed92f-9c24-4ba6-b589-9a729a8a4870 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:05.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2bed92f-9c24-4ba6-b589-9a729a8a4870 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:07.516Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T11:36:07.516Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:36:07.529Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:36:07.530Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:36:07.530Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:36:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26816807-53c0-4fa0-a92d-8db88305f8b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26816807-53c0-4fa0-a92d-8db88305f8b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@350090f0 2021-04-14T11:36:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26816807-53c0-4fa0-a92d-8db88305f8b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26816807-53c0-4fa0-a92d-8db88305f8b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:12.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bcc5f4d-f974-4b79-b375-81637919e88b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:12.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bcc5f4d-f974-4b79-b375-81637919e88b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b6aab8 2021-04-14T11:36:12.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bcc5f4d-f974-4b79-b375-81637919e88b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:12.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bcc5f4d-f974-4b79-b375-81637919e88b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:15.271Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=080fd9a7-e94a-4946-8145-c150bceb1d65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:15.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=080fd9a7-e94a-4946-8145-c150bceb1d65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65b69e48 2021-04-14T11:36:15.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=080fd9a7-e94a-4946-8145-c150bceb1d65 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:15.272Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=080fd9a7-e94a-4946-8145-c150bceb1d65 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@380896a4 2021-04-14T11:36:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:20.897Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:36:20.898Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:36:20.898Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:36:20.898Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5c385f9a-b6a2-4c2b-8090-b55393b7990f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:36:33.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c1bffc7-8e66-4662-8c38-1aea991ea7a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:33.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c1bffc7-8e66-4662-8c38-1aea991ea7a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@93e0645 2021-04-14T11:36:33.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c1bffc7-8e66-4662-8c38-1aea991ea7a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:33.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c1bffc7-8e66-4662-8c38-1aea991ea7a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:36.055Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1c1bffc7-8e66-4662-8c38-1aea991ea7a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:36:36.056Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1c1bffc7-8e66-4662-8c38-1aea991ea7a5 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:36:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:36:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:36:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:36:41.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c98a5e-1ae8-4d33-8a8f-71bab5ee4055 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:41.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c98a5e-1ae8-4d33-8a8f-71bab5ee4055 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4140e86 2021-04-14T11:36:41.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c98a5e-1ae8-4d33-8a8f-71bab5ee4055 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:41.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86c98a5e-1ae8-4d33-8a8f-71bab5ee4055 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:41.846Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:36:44.745Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=86c98a5e-1ae8-4d33-8a8f-71bab5ee4055 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:36:44.746Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=86c98a5e-1ae8-4d33-8a8f-71bab5ee4055 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:36:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:36:48.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:36:50.466Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2579cc9c-56ba-414a-a080-3326d4365493 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:50.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2579cc9c-56ba-414a-a080-3326d4365493 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a02867 2021-04-14T11:36:50.467Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2579cc9c-56ba-414a-a080-3326d4365493 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:50.468Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2579cc9c-56ba-414a-a080-3326d4365493 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:50.871Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:36:53.480Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2579cc9c-56ba-414a-a080-3326d4365493 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:36:53.480Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2579cc9c-56ba-414a-a080-3326d4365493 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:36:55.351Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac2693aa-7bdf-40d0-bb27-80bc5aad79b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:55.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac2693aa-7bdf-40d0-bb27-80bc5aad79b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cc99744 2021-04-14T11:36:55.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac2693aa-7bdf-40d0-bb27-80bc5aad79b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:55.352Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac2693aa-7bdf-40d0-bb27-80bc5aad79b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:36:58.363Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ac2693aa-7bdf-40d0-bb27-80bc5aad79b0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:36:58.364Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ac2693aa-7bdf-40d0-bb27-80bc5aad79b0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:36:58.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da08207-b0a7-467d-86fd-1171d5622199 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:36:58.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da08207-b0a7-467d-86fd-1171d5622199 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c073695 2021-04-14T11:36:58.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da08207-b0a7-467d-86fd-1171d5622199 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:36:58.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da08207-b0a7-467d-86fd-1171d5622199 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:01.740Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0da08207-b0a7-467d-86fd-1171d5622199 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:01.741Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0da08207-b0a7-467d-86fd-1171d5622199 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89a1926-757a-4a66-a5db-5460c1c2563d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89a1926-757a-4a66-a5db-5460c1c2563d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ae8c474 2021-04-14T11:37:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89a1926-757a-4a66-a5db-5460c1c2563d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e89a1926-757a-4a66-a5db-5460c1c2563d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:37:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:37:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:37:05.836Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e89a1926-757a-4a66-a5db-5460c1c2563d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:05.837Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e89a1926-757a-4a66-a5db-5460c1c2563d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:06.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c39ac7b-76f5-46b9-b390-d3ec305e82a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:06.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c39ac7b-76f5-46b9-b390-d3ec305e82a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35a33f6c 2021-04-14T11:37:06.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c39ac7b-76f5-46b9-b390-d3ec305e82a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:06.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c39ac7b-76f5-46b9-b390-d3ec305e82a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:09.796Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4c39ac7b-76f5-46b9-b390-d3ec305e82a0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:09.797Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4c39ac7b-76f5-46b9-b390-d3ec305e82a0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:10.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2304fc2b-325d-45de-9bb6-e5c61ec47aed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:10.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2304fc2b-325d-45de-9bb6-e5c61ec47aed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bf3bee3 2021-04-14T11:37:10.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2304fc2b-325d-45de-9bb6-e5c61ec47aed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:10.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2304fc2b-325d-45de-9bb6-e5c61ec47aed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:11.061Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:37:11.061Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:37:11.062Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:37:13.750Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2304fc2b-325d-45de-9bb6-e5c61ec47aed ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:37:13.750Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2304fc2b-325d-45de-9bb6-e5c61ec47aed ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:37:14.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4c10d27-4f95-4321-ad9d-c99a2ec08631 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:14.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4c10d27-4f95-4321-ad9d-c99a2ec08631 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fb9a09e 2021-04-14T11:37:14.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4c10d27-4f95-4321-ad9d-c99a2ec08631 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:14.455Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4c10d27-4f95-4321-ad9d-c99a2ec08631 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:17.465Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b4c10d27-4f95-4321-ad9d-c99a2ec08631 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:17.465Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b4c10d27-4f95-4321-ad9d-c99a2ec08631 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:17.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf11ae3-cfcc-462f-96e5-0a6bd6cd1ded PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:17.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf11ae3-cfcc-462f-96e5-0a6bd6cd1ded PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ec0e36a 2021-04-14T11:37:17.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf11ae3-cfcc-462f-96e5-0a6bd6cd1ded PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:17.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acf11ae3-cfcc-462f-96e5-0a6bd6cd1ded PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:20.988Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=acf11ae3-cfcc-462f-96e5-0a6bd6cd1ded ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:20.989Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=acf11ae3-cfcc-462f-96e5-0a6bd6cd1ded ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:21.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ca3d71-5449-4f08-9362-1c37bc19c3fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:21.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ca3d71-5449-4f08-9362-1c37bc19c3fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62926736 2021-04-14T11:37:21.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ca3d71-5449-4f08-9362-1c37bc19c3fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:21.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ca3d71-5449-4f08-9362-1c37bc19c3fe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:24.340Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f3ca3d71-5449-4f08-9362-1c37bc19c3fe ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:24.340Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f3ca3d71-5449-4f08-9362-1c37bc19c3fe ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:25.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e6ff78-1628-493d-8b3b-ca11a6fb5b18 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:25.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e6ff78-1628-493d-8b3b-ca11a6fb5b18 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71f957f7 2021-04-14T11:37:25.429Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e6ff78-1628-493d-8b3b-ca11a6fb5b18 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:25.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e6ff78-1628-493d-8b3b-ca11a6fb5b18 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:28.440Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=70e6ff78-1628-493d-8b3b-ca11a6fb5b18 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:28.440Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=70e6ff78-1628-493d-8b3b-ca11a6fb5b18 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:29.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9743c8-7575-4168-98b0-f5317470f14e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:29.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9743c8-7575-4168-98b0-f5317470f14e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c453ee9 2021-04-14T11:37:29.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9743c8-7575-4168-98b0-f5317470f14e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:29.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c9743c8-7575-4168-98b0-f5317470f14e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:32.221Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4c9743c8-7575-4168-98b0-f5317470f14e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:32.221Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4c9743c8-7575-4168-98b0-f5317470f14e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ef32d9-b052-40ec-85c0-fc11ad0d2904 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ef32d9-b052-40ec-85c0-fc11ad0d2904 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d3b17f 2021-04-14T11:37:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ef32d9-b052-40ec-85c0-fc11ad0d2904 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62ef32d9-b052-40ec-85c0-fc11ad0d2904 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:36.023Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=62ef32d9-b052-40ec-85c0-fc11ad0d2904 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:36.023Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=62ef32d9-b052-40ec-85c0-fc11ad0d2904 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:37.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a6a6d0f-fc23-4fb1-90ca-8184ced6e1e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:37.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a6a6d0f-fc23-4fb1-90ca-8184ced6e1e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24c1f23e 2021-04-14T11:37:37.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a6a6d0f-fc23-4fb1-90ca-8184ced6e1e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:37.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a6a6d0f-fc23-4fb1-90ca-8184ced6e1e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:38.348Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4a6a6d0f-fc23-4fb1-90ca-8184ced6e1e9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:38.348Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=4a6a6d0f-fc23-4fb1-90ca-8184ced6e1e9 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:38.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da35d89a-68c4-41a8-9c36-db9cef0ff5f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:38.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da35d89a-68c4-41a8-9c36-db9cef0ff5f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@721f3576 2021-04-14T11:37:38.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da35d89a-68c4-41a8-9c36-db9cef0ff5f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:38.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da35d89a-68c4-41a8-9c36-db9cef0ff5f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:39.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46fd1a3-5d8b-4373-afc2-95418bb1c06a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:39.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46fd1a3-5d8b-4373-afc2-95418bb1c06a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@323d5920 2021-04-14T11:37:39.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46fd1a3-5d8b-4373-afc2-95418bb1c06a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:39.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c46fd1a3-5d8b-4373-afc2-95418bb1c06a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:40.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5e301d2-b21e-47bc-a89f-8ee5b31e413f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:40.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5e301d2-b21e-47bc-a89f-8ee5b31e413f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19461d5b 2021-04-14T11:37:40.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5e301d2-b21e-47bc-a89f-8ee5b31e413f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:40.073Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5e301d2-b21e-47bc-a89f-8ee5b31e413f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:40.434Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f9b264-d42f-4180-a338-0151b7e8e71b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:40.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f9b264-d42f-4180-a338-0151b7e8e71b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11d96869 2021-04-14T11:37:40.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f9b264-d42f-4180-a338-0151b7e8e71b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:40.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f9b264-d42f-4180-a338-0151b7e8e71b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:40.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b004e703-7959-4584-97ac-49602dfd1e58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:40.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b004e703-7959-4584-97ac-49602dfd1e58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ae65ba1 2021-04-14T11:37:40.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b004e703-7959-4584-97ac-49602dfd1e58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:40.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b004e703-7959-4584-97ac-49602dfd1e58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@424ae584 2021-04-14T11:37:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:42.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:37:42.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:37:44.593Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:37:44.594Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:37:44.594Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:44.594Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ecc4619d-ed58-487f-90ac-17cf04f9942f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:37:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:37:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:37:52.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=605c4782-31e1-4722-a503-2af2864cee24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:52.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=605c4782-31e1-4722-a503-2af2864cee24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b4f9453 2021-04-14T11:37:52.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=605c4782-31e1-4722-a503-2af2864cee24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:52.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=605c4782-31e1-4722-a503-2af2864cee24 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:53.843Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:37:55.861Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=605c4782-31e1-4722-a503-2af2864cee24 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:37:55.862Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=605c4782-31e1-4722-a503-2af2864cee24 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:37:55.862Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=605c4782-31e1-4722-a503-2af2864cee24 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:55.862Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=605c4782-31e1-4722-a503-2af2864cee24 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:37:56.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e1b378c-e936-4da8-98f1-6a0d03127fe9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:56.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e1b378c-e936-4da8-98f1-6a0d03127fe9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@199c5da0 2021-04-14T11:37:56.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e1b378c-e936-4da8-98f1-6a0d03127fe9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:56.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e1b378c-e936-4da8-98f1-6a0d03127fe9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:37:58.797Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2e1b378c-e936-4da8-98f1-6a0d03127fe9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:58.798Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=2e1b378c-e936-4da8-98f1-6a0d03127fe9 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:37:59.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:37:59.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b950d00 2021-04-14T11:37:59.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:37:59.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:38:00.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:38:02.213Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:38:02.214Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:38:02.214Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:02.215Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=14526a57-3b20-4bb9-bb2a-541329d4ae35 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:02.942Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:38:03.386Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098649-f82f-4738-bdbd-3fabd6628759 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:03.386Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098649-f82f-4738-bdbd-3fabd6628759 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5349b1ba 2021-04-14T11:38:03.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098649-f82f-4738-bdbd-3fabd6628759 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:03.387Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098649-f82f-4738-bdbd-3fabd6628759 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:38:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:38:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:38:06.304Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d1098649-f82f-4738-bdbd-3fabd6628759 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:06.305Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=d1098649-f82f-4738-bdbd-3fabd6628759 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:38:06.548Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:38:06.548Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:38:06.549Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:38:06.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d2da72e-f4ea-47f7-a134-0bdc013c64a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:06.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d2da72e-f4ea-47f7-a134-0bdc013c64a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bb16e89 2021-04-14T11:38:06.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d2da72e-f4ea-47f7-a134-0bdc013c64a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:06.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d2da72e-f4ea-47f7-a134-0bdc013c64a3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:07.417Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8d2da72e-f4ea-47f7-a134-0bdc013c64a3 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:07.417Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8d2da72e-f4ea-47f7-a134-0bdc013c64a3 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:08.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:08.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@687f95f2 2021-04-14T11:38:08.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:08.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:11.043Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:38:11.043Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:38:11.043Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:11.044Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c410fa0b-27a0-4247-aa6c-9aa6a37e7e1e ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a78eeb0e-a831-41a1-8668-16aaac0b0b26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a78eeb0e-a831-41a1-8668-16aaac0b0b26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76a53d26 2021-04-14T11:38:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a78eeb0e-a831-41a1-8668-16aaac0b0b26 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a78eeb0e-a831-41a1-8668-16aaac0b0b26 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:38:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:38:14.046Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a78eeb0e-a831-41a1-8668-16aaac0b0b26 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:14.046Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a78eeb0e-a831-41a1-8668-16aaac0b0b26 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:14.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6d8fd6-165c-497a-9f71-13dd14d8052e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:14.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6d8fd6-165c-497a-9f71-13dd14d8052e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@127e55d9 2021-04-14T11:38:14.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6d8fd6-165c-497a-9f71-13dd14d8052e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:14.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6d8fd6-165c-497a-9f71-13dd14d8052e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:14.885Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:38:15.356Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3a6d8fd6-165c-497a-9f71-13dd14d8052e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:15.356Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3a6d8fd6-165c-497a-9f71-13dd14d8052e ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:38:16.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf9983e-2156-4cea-b8bd-60f04bee66b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:16.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf9983e-2156-4cea-b8bd-60f04bee66b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63a8261 2021-04-14T11:38:16.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf9983e-2156-4cea-b8bd-60f04bee66b4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:16.403Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf9983e-2156-4cea-b8bd-60f04bee66b4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:17.019Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cdf9983e-2156-4cea-b8bd-60f04bee66b4 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:17.019Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cdf9983e-2156-4cea-b8bd-60f04bee66b4 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:17.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec37216-6714-4a37-a4e3-11dbcd64c48a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:17.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec37216-6714-4a37-a4e3-11dbcd64c48a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5929d38d 2021-04-14T11:38:17.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec37216-6714-4a37-a4e3-11dbcd64c48a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:17.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec37216-6714-4a37-a4e3-11dbcd64c48a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:18.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fa4444-2c48-4275-aa03-76abc97344ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:18.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fa4444-2c48-4275-aa03-76abc97344ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46aca4e5 2021-04-14T11:38:18.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fa4444-2c48-4275-aa03-76abc97344ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:18.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18fa4444-2c48-4275-aa03-76abc97344ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:19.503Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b9ce74-580e-4cc8-b15c-ab5d9255e547 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:19.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b9ce74-580e-4cc8-b15c-ab5d9255e547 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@269ce174 2021-04-14T11:38:19.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b9ce74-580e-4cc8-b15c-ab5d9255e547 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:19.504Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69b9ce74-580e-4cc8-b15c-ab5d9255e547 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:20.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62d1267a-9f19-4297-a0ed-7b85ac54ebb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:20.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62d1267a-9f19-4297-a0ed-7b85ac54ebb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74e7564c 2021-04-14T11:38:20.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62d1267a-9f19-4297-a0ed-7b85ac54ebb6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:20.302Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62d1267a-9f19-4297-a0ed-7b85ac54ebb6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298038d1-266f-494d-8949-d2c3627e2ace PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298038d1-266f-494d-8949-d2c3627e2ace PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63c546e6 2021-04-14T11:38:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298038d1-266f-494d-8949-d2c3627e2ace PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=298038d1-266f-494d-8949-d2c3627e2ace PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:24.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c420bee0-1a00-44f3-a882-2b905c6d483b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:24.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c420bee0-1a00-44f3-a882-2b905c6d483b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@406d4df7 2021-04-14T11:38:24.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c420bee0-1a00-44f3-a882-2b905c6d483b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:24.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c420bee0-1a00-44f3-a882-2b905c6d483b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:26.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522e1927-3782-4968-ac9f-7eab13495183 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:26.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522e1927-3782-4968-ac9f-7eab13495183 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bb93cf 2021-04-14T11:38:26.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522e1927-3782-4968-ac9f-7eab13495183 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:26.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522e1927-3782-4968-ac9f-7eab13495183 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:38:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:38:29.445Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=522e1927-3782-4968-ac9f-7eab13495183 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:38:29.445Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=522e1927-3782-4968-ac9f-7eab13495183 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:38:29.445Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=522e1927-3782-4968-ac9f-7eab13495183 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:29.445Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=522e1927-3782-4968-ac9f-7eab13495183 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:29.918Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:38:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f20f082 2021-04-14T11:38:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:30.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:33.773Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:38:33.773Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:38:33.773Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:33.773Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=d1098cf4-1f5c-4323-a3c8-5600b2fac686 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:38:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ec02d8d-e0cc-452f-9b68-d5b4c5cfe23e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ec02d8d-e0cc-452f-9b68-d5b4c5cfe23e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cb38a27 2021-04-14T11:38:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ec02d8d-e0cc-452f-9b68-d5b4c5cfe23e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:34.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ec02d8d-e0cc-452f-9b68-d5b4c5cfe23e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:35.994Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8ec02d8d-e0cc-452f-9b68-d5b4c5cfe23e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:35.994Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8ec02d8d-e0cc-452f-9b68-d5b4c5cfe23e ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:38:36.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a506bd0f-1620-4b77-b95c-7925c1f17b54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:36.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a506bd0f-1620-4b77-b95c-7925c1f17b54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39271bde 2021-04-14T11:38:36.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a506bd0f-1620-4b77-b95c-7925c1f17b54 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:36.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a506bd0f-1620-4b77-b95c-7925c1f17b54 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b20c9ad-fd35-4fcf-91a6-6ef4a2be692a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b20c9ad-fd35-4fcf-91a6-6ef4a2be692a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@648e25d1 2021-04-14T11:38:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b20c9ad-fd35-4fcf-91a6-6ef4a2be692a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b20c9ad-fd35-4fcf-91a6-6ef4a2be692a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:40.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7112928a-b9be-4c5d-bd1b-a0dd41992710 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:40.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7112928a-b9be-4c5d-bd1b-a0dd41992710 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@545c69d5 2021-04-14T11:38:40.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7112928a-b9be-4c5d-bd1b-a0dd41992710 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:40.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7112928a-b9be-4c5d-bd1b-a0dd41992710 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:40.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd000013-96b9-49c5-8622-8325a915b97b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:40.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd000013-96b9-49c5-8622-8325a915b97b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fb04d32 2021-04-14T11:38:40.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd000013-96b9-49c5-8622-8325a915b97b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:40.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd000013-96b9-49c5-8622-8325a915b97b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:41.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e00b66a-d460-4ed0-a6b6-d29d86f2cfef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:41.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e00b66a-d460-4ed0-a6b6-d29d86f2cfef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ec840f1 2021-04-14T11:38:41.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e00b66a-d460-4ed0-a6b6-d29d86f2cfef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:41.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e00b66a-d460-4ed0-a6b6-d29d86f2cfef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:41.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d49dc0e-14ac-4b72-bea4-c2aa8ee3f835 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:41.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d49dc0e-14ac-4b72-bea4-c2aa8ee3f835 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bfd4254 2021-04-14T11:38:41.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d49dc0e-14ac-4b72-bea4-c2aa8ee3f835 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:41.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d49dc0e-14ac-4b72-bea4-c2aa8ee3f835 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:42.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c301caf-27f4-49c4-a498-29d6eb76d8a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:42.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c301caf-27f4-49c4-a498-29d6eb76d8a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cd88c3f 2021-04-14T11:38:42.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c301caf-27f4-49c4-a498-29d6eb76d8a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:42.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c301caf-27f4-49c4-a498-29d6eb76d8a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:43.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=096c5acd-e447-48a9-a4ac-fdd8502eff0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:43.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=096c5acd-e447-48a9-a4ac-fdd8502eff0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@217c934b 2021-04-14T11:38:43.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=096c5acd-e447-48a9-a4ac-fdd8502eff0b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:43.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=096c5acd-e447-48a9-a4ac-fdd8502eff0b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:44.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03dd4858-5ca6-4b79-b7bc-ca2b459da4cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:44.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03dd4858-5ca6-4b79-b7bc-ca2b459da4cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d8f805d 2021-04-14T11:38:44.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03dd4858-5ca6-4b79-b7bc-ca2b459da4cf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:44.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03dd4858-5ca6-4b79-b7bc-ca2b459da4cf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:46.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=346da475-4128-4cf3-a0f0-69b8f6072cd1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=346da475-4128-4cf3-a0f0-69b8f6072cd1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c619e5a 2021-04-14T11:38:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=346da475-4128-4cf3-a0f0-69b8f6072cd1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:46.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=346da475-4128-4cf3-a0f0-69b8f6072cd1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:48.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aad59456-abef-4f2b-b507-ab98d5a9262a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:48.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aad59456-abef-4f2b-b507-ab98d5a9262a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c0409d 2021-04-14T11:38:48.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aad59456-abef-4f2b-b507-ab98d5a9262a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:48.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aad59456-abef-4f2b-b507-ab98d5a9262a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc665711-66d3-4408-802f-225265b252b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc665711-66d3-4408-802f-225265b252b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41637d85 2021-04-14T11:38:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc665711-66d3-4408-802f-225265b252b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc665711-66d3-4408-802f-225265b252b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:54.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7108a4b-5b27-46a0-ad84-aede9532fc1c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:38:54.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7108a4b-5b27-46a0-ad84-aede9532fc1c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@200f809c 2021-04-14T11:38:54.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7108a4b-5b27-46a0-ad84-aede9532fc1c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:38:54.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7108a4b-5b27-46a0-ad84-aede9532fc1c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:38:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:38:57.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:39:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:39:02.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4cf24a6-f5e0-4c5d-a2c1-bd5ea965c4c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:02.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4cf24a6-f5e0-4c5d-a2c1-bd5ea965c4c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@300c5989 2021-04-14T11:39:02.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4cf24a6-f5e0-4c5d-a2c1-bd5ea965c4c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:02.650Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4cf24a6-f5e0-4c5d-a2c1-bd5ea965c4c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:02.912Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:39:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:39:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:39:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:39:04.384Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 500 Server Error 2021-04-14T11:39:04.384Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=fetchFromTopic Error occured during access to U-EB Server. Operation: get messages from topic 2021-04-14T11:39:04.385Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=INTERNAL_SERVER_ERROR, httpCode=500, variables=[]] 2021-04-14T11:39:04.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f771c6c-3e56-478d-b974-3406e992ad43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:04.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f771c6c-3e56-478d-b974-3406e992ad43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@364e23bd 2021-04-14T11:39:04.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f771c6c-3e56-478d-b974-3406e992ad43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:04.451Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f771c6c-3e56-478d-b974-3406e992ad43 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:05.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e65aec-75ab-4eec-b58b-e8f4f59a99bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:05.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e65aec-75ab-4eec-b58b-e8f4f59a99bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c1bffa4 2021-04-14T11:39:05.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e65aec-75ab-4eec-b58b-e8f4f59a99bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:05.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e65aec-75ab-4eec-b58b-e8f4f59a99bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:07.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20409d65-3a76-409c-8dc6-ae7df1022e08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:07.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20409d65-3a76-409c-8dc6-ae7df1022e08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@304c89db 2021-04-14T11:39:07.242Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20409d65-3a76-409c-8dc6-ae7df1022e08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:07.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20409d65-3a76-409c-8dc6-ae7df1022e08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2882326-0a55-4468-a2cb-7cda980e5f29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2882326-0a55-4468-a2cb-7cda980e5f29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@625e4e4a 2021-04-14T11:39:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2882326-0a55-4468-a2cb-7cda980e5f29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2882326-0a55-4468-a2cb-7cda980e5f29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:12.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d7ffb4-488f-4f96-814e-32b03cb3e3d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:12.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d7ffb4-488f-4f96-814e-32b03cb3e3d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@254ada77 2021-04-14T11:39:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d7ffb4-488f-4f96-814e-32b03cb3e3d0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66d7ffb4-488f-4f96-814e-32b03cb3e3d0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:14.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432e096f-6373-46ed-b230-10473c5bcd18 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:14.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432e096f-6373-46ed-b230-10473c5bcd18 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@169fe7a5 2021-04-14T11:39:14.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432e096f-6373-46ed-b230-10473c5bcd18 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:14.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432e096f-6373-46ed-b230-10473c5bcd18 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccc695e-b47f-4a41-9eb9-8cea78b3cd4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccc695e-b47f-4a41-9eb9-8cea78b3cd4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4249b6fc 2021-04-14T11:39:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccc695e-b47f-4a41-9eb9-8cea78b3cd4b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ccc695e-b47f-4a41-9eb9-8cea78b3cd4b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:21.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a59f8b4-e6c7-498f-a981-2f79f7bad6c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:21.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a59f8b4-e6c7-498f-a981-2f79f7bad6c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52f59ce1 2021-04-14T11:39:21.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a59f8b4-e6c7-498f-a981-2f79f7bad6c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:21.343Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a59f8b4-e6c7-498f-a981-2f79f7bad6c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c73acb-9442-4a22-b649-9c5605dfac4e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c73acb-9442-4a22-b649-9c5605dfac4e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@211f6daa 2021-04-14T11:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c73acb-9442-4a22-b649-9c5605dfac4e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58c73acb-9442-4a22-b649-9c5605dfac4e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:26.043Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond 2021-04-14T11:39:26.043Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T11:39:26.052Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.060Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.062Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.063Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.065Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.066Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.067Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.070Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.071Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.073Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.074Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.075Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.076Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.077Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.078Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.080Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.081Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.082Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.083Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.084Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.085Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.087Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.088Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.089Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.090Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.091Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.093Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.094Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.095Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.096Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.097Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.098Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.099Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.100Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.101Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.102Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.104Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.105Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.106Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.107Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.108Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.109Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.110Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.111Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.112Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.113Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.114Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.115Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.116Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.117Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.118Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.120Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.121Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.122Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.123Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.124Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.125Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.126Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.127Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.128Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.129Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.130Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.131Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.132Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.133Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.134Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.135Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.136Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.137Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.137Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.138Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.139Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.140Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.141Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.142Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.143Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.144Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.145Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.146Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.147Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.148Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.149Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.150Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.151Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.151Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.152Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.153Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.154Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.155Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.156Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.157Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.158Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.159Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.160Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.161Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.161Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.162Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.163Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.164Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.165Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.166Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.167Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.168Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.169Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.170Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.171Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.172Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.172Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.173Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.174Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.175Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.176Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.177Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.178Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.179Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.180Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.181Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.181Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.182Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.183Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.184Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.185Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.186Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.186Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.187Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.204Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.205Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.205Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.207Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.207Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.208Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.209Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.210Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.211Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.212Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.213Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.213Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.214Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.215Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.216Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.217Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.218Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.219Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.219Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.220Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.221Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.222Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.223Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.224Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.225Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.225Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.226Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.227Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.228Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.229Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.229Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.230Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.231Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.232Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.233Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.234Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.234Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.235Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.236Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.237Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.238Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.239Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.239Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.240Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.241Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.242Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.243Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.244Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.244Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.245Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.246Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.247Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.247Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.248Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.249Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.250Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.251Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.252Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.252Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.254Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.255Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.256Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.257Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.258Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.259Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.260Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.260Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.261Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.262Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.263Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.264Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.265Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.265Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.266Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.267Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.269Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.270Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.271Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.271Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.272Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.273Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.274Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.275Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.276Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.277Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.277Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.278Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.280Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.280Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.282Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.282Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.284Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.285Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.287Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.288Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.292Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.293Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.294Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.295Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.297Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.298Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.300Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.301Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.302Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.303Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.304Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.306Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.307Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.308Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.309Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.310Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.320Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.321Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.322Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.323Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.324Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.325Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.325Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.326Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.327Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.328Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.329Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.330Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.331Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.332Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.333Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.333Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.334Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.335Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.336Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.337Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.337Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.338Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.339Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.340Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.342Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.343Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.344Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.345Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.346Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.347Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.348Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.349Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.350Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.351Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.352Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.353Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.354Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.354Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.355Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.356Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.357Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.358Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.359Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.360Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.361Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.362Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.363Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.364Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.365Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.366Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.367Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.368Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.369Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.370Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.371Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.372Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.373Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.374Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.375Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.376Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.376Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.377Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.378Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.379Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.380Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.381Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.382Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.382Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.383Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.384Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.385Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.386Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.387Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.388Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.389Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.389Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.390Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.391Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.392Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.393Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.394Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.395Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.396Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.397Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.397Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.398Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.399Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.400Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.401Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.402Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.403Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.404Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.404Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.405Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.406Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.407Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.408Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.409Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.410Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.411Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.412Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.412Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.413Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.414Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.415Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.416Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.417Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.417Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.418Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.419Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.420Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.421Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.421Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.422Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.423Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.424Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.425Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.426Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.426Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.427Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.428Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.429Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.430Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.430Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.431Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.432Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.433Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.433Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.434Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.435Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.436Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.437Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.437Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.438Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.439Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.440Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.440Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.441Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.442Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.443Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.444Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.445Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.445Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.446Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.447Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.448Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.449Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.450Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.451Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.451Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.452Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.453Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.454Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.454Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.457Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.458Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.458Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.459Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.460Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.460Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.461Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.462Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.463Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.464Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.465Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.465Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.466Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.467Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.469Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.471Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.472Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.473Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.474Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.475Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.477Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.478Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.479Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.480Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.481Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.482Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.483Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.484Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.485Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.486Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.487Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.488Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.489Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.490Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.491Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.492Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.493Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.494Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.495Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.496Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.497Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.498Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.499Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.500Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.513Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.514Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.515Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.516Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.517Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.518Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.519Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.520Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.522Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.523Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.524Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.525Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.526Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:26.527Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:26.528Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:27.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef1a85a4-1c72-405f-a967-356ffb1f5ae2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:27.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef1a85a4-1c72-405f-a967-356ffb1f5ae2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@485404e3 2021-04-14T11:39:27.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef1a85a4-1c72-405f-a967-356ffb1f5ae2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:27.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef1a85a4-1c72-405f-a967-356ffb1f5ae2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:30.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7c8931-a307-4d9f-9074-a8fe22837278 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:30.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7c8931-a307-4d9f-9074-a8fe22837278 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4725b543 2021-04-14T11:39:30.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7c8931-a307-4d9f-9074-a8fe22837278 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:30.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7c8931-a307-4d9f-9074-a8fe22837278 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:32.930Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=65460e43-a46f-4260-a78d-d581988419ca InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:39:32.929158Z InvocationID=9aca2b85-d89b-4122-a397-aaaab2cea7ee LogTimestamp=2021-04-14T11:39:32.929448Z Entering 2021-04-14T11:39:32.930Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=65460e43-a46f-4260-a78d-d581988419ca InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:39:32.929158Z InvocationID=9aca2b85-d89b-4122-a397-aaaab2cea7ee LogTimestamp=2021-04-14T11:39:32.929448Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:39:32.935Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=4 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:39:32.931Z InvocationID=b0c8e690-77bc-4e49-a6b6-53b90ab81afd LogTimestamp=2021-04-14T11:39:32.935251Z ResponseDesc=OK Exiting. 2021-04-14T11:39:32.935Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:39:34.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdccc469-660a-484f-9d25-41d1100f2545 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:34.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdccc469-660a-484f-9d25-41d1100f2545 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39c93bd2 2021-04-14T11:39:34.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdccc469-660a-484f-9d25-41d1100f2545 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:34.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdccc469-660a-484f-9d25-41d1100f2545 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:39:36.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:39:37.947Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fdccc469-660a-484f-9d25-41d1100f2545 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:39:37.948Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fdccc469-660a-484f-9d25-41d1100f2545 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:39:37.948Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fdccc469-660a-484f-9d25-41d1100f2545 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:39:37.949Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fdccc469-660a-484f-9d25-41d1100f2545 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:39:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:39:41.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1abc0388-e2af-4215-b092-bd32884186a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:41.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1abc0388-e2af-4215-b092-bd32884186a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6361637c 2021-04-14T11:39:41.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1abc0388-e2af-4215-b092-bd32884186a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:41.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1abc0388-e2af-4215-b092-bd32884186a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:41.834Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:39:41.932Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1abc0388-e2af-4215-b092-bd32884186a5 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:39:41.932Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=1abc0388-e2af-4215-b092-bd32884186a5 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:39:42.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92bfe597-5c8b-4552-84a1-25f11f3d7d96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:42.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92bfe597-5c8b-4552-84a1-25f11f3d7d96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@619f236e 2021-04-14T11:39:42.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92bfe597-5c8b-4552-84a1-25f11f3d7d96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:42.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92bfe597-5c8b-4552-84a1-25f11f3d7d96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:43.537Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=92bfe597-5c8b-4552-84a1-25f11f3d7d96 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:39:43.537Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=92bfe597-5c8b-4552-84a1-25f11f3d7d96 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:39:44.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3313c39-b85f-4f0e-96c0-1afeb86c5c6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:44.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3313c39-b85f-4f0e-96c0-1afeb86c5c6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11789324 2021-04-14T11:39:44.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3313c39-b85f-4f0e-96c0-1afeb86c5c6e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:44.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3313c39-b85f-4f0e-96c0-1afeb86c5c6e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:45.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3784fdad-0713-40fb-8bea-cc4f15e3be29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:45.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3784fdad-0713-40fb-8bea-cc4f15e3be29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@796a78f4 2021-04-14T11:39:45.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3784fdad-0713-40fb-8bea-cc4f15e3be29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:45.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3784fdad-0713-40fb-8bea-cc4f15e3be29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:39:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:39:48.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c1410e4-b4e1-4122-8d3e-03894f7cee74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:48.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c1410e4-b4e1-4122-8d3e-03894f7cee74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22cc624e 2021-04-14T11:39:48.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c1410e4-b4e1-4122-8d3e-03894f7cee74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:48.246Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c1410e4-b4e1-4122-8d3e-03894f7cee74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:51.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff769ed-8f5c-43ef-a4b4-fa5780c5a207 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:51.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff769ed-8f5c-43ef-a4b4-fa5780c5a207 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ad0b12a 2021-04-14T11:39:51.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff769ed-8f5c-43ef-a4b4-fa5780c5a207 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:51.963Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dff769ed-8f5c-43ef-a4b4-fa5780c5a207 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:39:53.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de60fffc-1686-4546-b538-4e4e022a19df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:39:53.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de60fffc-1686-4546-b538-4e4e022a19df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f64f4e7 2021-04-14T11:39:53.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de60fffc-1686-4546-b538-4e4e022a19df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:39:53.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de60fffc-1686-4546-b538-4e4e022a19df PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:40:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:40:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:02.831Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:40:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:40:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:40:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:40:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:40:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:40:11.495Z [cluster1-nio-worker-1] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:215) at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:40:11.496Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.70.81:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69) at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282) at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264) at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42) at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:215) at com.datastax.driver.core.DefaultResultSetFuture.onSet(DefaultResultSetFuture.java:242) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:40:11.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18683c4b-6f4a-48a9-91bc-f55beeeb9692 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:11.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18683c4b-6f4a-48a9-91bc-f55beeeb9692 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45639c27 2021-04-14T11:40:11.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18683c4b-6f4a-48a9-91bc-f55beeeb9692 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:11.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18683c4b-6f4a-48a9-91bc-f55beeeb9692 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:40:12.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2beec0f-ba33-4528-891e-54657e4e9b38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:12.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2beec0f-ba33-4528-891e-54657e4e9b38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fc58d7 2021-04-14T11:40:12.628Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2beec0f-ba33-4528-891e-54657e4e9b38 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:12.629Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2beec0f-ba33-4528-891e-54657e4e9b38 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:40:13.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16f4a492-17f0-4b86-b473-768b7eb63466 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:13.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16f4a492-17f0-4b86-b473-768b7eb63466 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b9ae083 2021-04-14T11:40:13.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16f4a492-17f0-4b86-b473-768b7eb63466 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:13.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16f4a492-17f0-4b86-b473-768b7eb63466 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:14.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a268176f-c28e-4603-9b20-95211f19d871 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:14.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a268176f-c28e-4603-9b20-95211f19d871 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7391e8db 2021-04-14T11:40:14.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a268176f-c28e-4603-9b20-95211f19d871 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:14.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a268176f-c28e-4603-9b20-95211f19d871 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:15.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:15.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a4ad02a 2021-04-14T11:40:15.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:15.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:16.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:16.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:16.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:18.819Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:40:18.819Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:40:18.820Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:40:18.820Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bb3319fd-0b49-436c-a06e-5321fecd3d5c ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:40:30.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=393f9a44-98af-4dd2-a014-9c5d96be60f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:30.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=393f9a44-98af-4dd2-a014-9c5d96be60f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c961f54 2021-04-14T11:40:30.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=393f9a44-98af-4dd2-a014-9c5d96be60f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:30.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=393f9a44-98af-4dd2-a014-9c5d96be60f8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:33.956Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=393f9a44-98af-4dd2-a014-9c5d96be60f8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:40:33.956Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=393f9a44-98af-4dd2-a014-9c5d96be60f8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:40:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322be43-eff0-46aa-b6bf-1a676fc9e00d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322be43-eff0-46aa-b6bf-1a676fc9e00d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c4f834a 2021-04-14T11:40:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322be43-eff0-46aa-b6bf-1a676fc9e00d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:34.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8322be43-eff0-46aa-b6bf-1a676fc9e00d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:34.581Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01b469894grlw41k0zwcaerz8uq16 2021-04-14T11:40:34.581Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01co8nm5jh2tiwxjtnvfi6ji9w25 2021-04-14T11:40:34.581Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01j5z19w6fxnlyiqojm4i4z3zu22 2021-04-14T11:40:34.581Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tsodxdr59sq717uh73h3wky7p31 2021-04-14T11:40:34.581Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0md5lnd8fbql51gvfqhzz4ie5284 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01w8k8ouw7pimz1u8foio7yumki38 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bu58j91logvfg2x8rehnap021 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01waqnwr33oigiacoqurc0dslc60 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04fxy3ab901rg1wjwb0zk4tnb745 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0q55ge7mqoeyhcemew49pz69t33 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0154kraf7uu8qm1wy9bop46o4kn76 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01d2r5k9fnpqr3z31ho4xldck696 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0paa1lphak60ypelf3hvo28k827 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0106o96d965ftj1ba3mc8gpkz2c17 2021-04-14T11:40:34.582Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0opq2lnpm5ah31kuuxdgo0wnwj4 2021-04-14T11:40:34.583Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gaowkx6sh7h1m7hds7zu92rt102 2021-04-14T11:40:34.583Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lccvg1nphocx1hxamf1lnx4vs36 2021-04-14T11:40:34.583Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0vrpte2op0khf3dyepmg13uzq63 2021-04-14T11:40:34.583Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01jbnk27wjobg21oa5fg72bjh9k74 2021-04-14T11:40:34.583Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xa8bbbxhya697xld017fzp5x80 2021-04-14T11:40:34.583Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0nuuhvwg6x8ohytfpeblfaiae0 2021-04-14T11:40:34.584Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cgwb7pg6sfv8a112xpwq4qoe11 2021-04-14T11:40:34.584Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016vnj4s9o1xfw1owiw6iuxhehq18 2021-04-14T11:40:34.584Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0n45tuz6dr0161m2du1r4xjqcp57 2021-04-14T11:40:34.585Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u0zi9fg3gt01rsp29kd8ak2d26 2021-04-14T11:40:34.585Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01eq94y46m194418ybuk1n7nosx42 2021-04-14T11:40:34.585Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01kqxo51lmdnq41amqd34hufjh959 2021-04-14T11:40:34.585Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0gmx1stt3q1z51pfg8rlatihqi50 2021-04-14T11:40:34.585Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0188ik6nzfvzvaqr7p1phbfj8152 2021-04-14T11:40:34.585Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015m2344t38l1p1eejiip33qoso47 2021-04-14T11:40:34.586Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d2u2g93pbzsjhce9f80q8v7p56 2021-04-14T11:40:34.586Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hgyeughkst9l6mygtnmhyqhr69 2021-04-14T11:40:34.586Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0uue2sscifz34uimhli5hzi5098 2021-04-14T11:40:34.586Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vecry9n7szvxm9i6spyr5zup85 2021-04-14T11:40:34.586Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nld2vkbpnb641dgkvk6is2qgk73 2021-04-14T11:40:34.586Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dm8kfs42lmhi1k2aea6l9luu792 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016l2npmsw4efupdyejajmduv343 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0htoitdj7fsy11jwq97cvwyz7f6 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01w9okd3h9tnmlsj57gp0sifra37 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qnov35jskyuk10usieb2uwvhl51 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gzw1l2qhgb831g8p3qwhn3m2x70 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nwm3ym5o9bq71d45niocy1vdd19 2021-04-14T11:40:34.587Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xsxuqvuarsxn1ukz56lxzbm8x64 2021-04-14T11:40:34.588Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01c2fh8fpzj7yuou7w2kltqua23 2021-04-14T11:40:34.588Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01txglgqyj770y1sqsmkcrbqaiw23 2021-04-14T11:40:34.588Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0a3kwkdiw6zs8fvu6rb2yw55295 2021-04-14T11:40:34.588Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0cuvgw5r5an4n1q9f0u42sh06m53 2021-04-14T11:40:34.588Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u2mkndbthfns13f72zb0xewsf83 2021-04-14T11:40:34.588Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01rx91d00jq7487lp00a6gpxs97 2021-04-14T11:40:34.589Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dovffe9oc6eq1vvunihn5qugj61 2021-04-14T11:40:34.589Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ll27vi642wxo1itc3e6091zzn87 2021-04-14T11:40:34.589Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qiizo5jcdjfvyc91eynldmyn28 2021-04-14T11:40:34.589Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nf9k0pducgi416f38navximzl49 2021-04-14T11:40:34.590Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0c3x9zzzzw8fe14danx7hom2dr2 2021-04-14T11:40:34.590Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yl55r5cmdnst17n8s24j9yyqk86 2021-04-14T11:40:34.590Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xxubsote0ttl166ggvw2pkhwf14 2021-04-14T11:40:34.590Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0fvfxpmcg0tj4usbgeii9k1ny30 2021-04-14T11:40:34.590Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node057b46u3qufdp1p8kxq2vjfyl78 2021-04-14T11:40:34.590Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0hvvdiivvh2ilditbyj1bs2yp12 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0t6a0x0q7t2ff1nwfgahz3waga75 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mml7ryftf5rtn32o8y9maf7v94 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01k7shmijepbunciiy7r3bb1a420 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01x91ps9fbfusl1iplpnzukfarn100 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0pogbbc2qh1gt1x54jh79ygmqh79 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01j1407hpxguhr1uyc47b2wzkmz5 2021-04-14T11:40:34.591Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node017zdz7f511lh01cybrr5m11pys10 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yvf2eue0szkxth3iyt09sk8546 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019ajv2dkdza5b1srgzfgcq0vbe71 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01arl6dhnaw4lxxlcf0gn4r6m632 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nkalikkmjikneddtkoklsav62 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010lu9me2vlv4dalrhy3xy5fmi39 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015e5yc6lv4rci1nshxvfwtid3755 2021-04-14T11:40:34.592Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xmv7vi6yb2wu1f7088dai40ai90 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01p114ooi93mt78ta4alaskfig72 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0cqymt2fvftdegzd3jxji4gk6103 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cb9mzut71w0r3uf441wh9nux48 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08xytu4g2e3gq1b73ffu4aigrt40 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0p6nnzaivpb3chi70vrqon7vh24 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01kbm30olu0k9m1j5wgttws3e8r58 2021-04-14T11:40:34.593Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0117ece2vvimzxub76u4bv4evq65 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0176fwtiqqze1prkyn1rhjvc2v34 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01aavevt67s90s1deebdinfhy7z101 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0fb0kl6eisufm1krvituiwkaex7 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s8qvwcotk8da1lfsstq4eurfx88 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0jzmycg346dfn1jgyi631wqh5h68 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0m6lqhqnq4fpz1a44nbwo0mwa444 2021-04-14T11:40:34.594Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0c4i99umzchnhtber5qozd7u082 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node011i971cdgolg7b4wzfpm569q38 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bbor3zlh3rvdug2mqge7qgu89 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01w69p7rfvpsos1tope7pwgbmt115 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01s26417u74qntf7mf8h09ras889 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nso2vgs21pep15fdrimmqd77x66 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01berupua7u0xc18x3sdpl2345w77 2021-04-14T11:40:34.595Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tze7g2yrkfyaev6kggv4qfj67 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01fxo0mo20hrb41dwrs1izpsasz13 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01a1j5uuk91h261f93aa5lbwxc81 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dvr8wt7l9432m5dtx8zky32p93 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0130skvmmwgmtp1fwhmza8ske6x91 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0zwq2wcdrmlan45dlhzb0wx9x99 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01a0nhkmysmw9t4rub07e4n4kv29 2021-04-14T11:40:34.596Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0f7280unbcn941ihtz0nbxisay54 2021-04-14T11:40:34.597Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node094py5trkih73hnzgfdzvc63k35 2021-04-14T11:40:34.597Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01t0bxlyb3r6pj1cv9dru7s575j41 2021-04-14T11:40:34.597Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qxcjga4kuw271xq26vlku67ab1 2021-04-14T11:40:37.800Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8322be43-eff0-46aa-b6bf-1a676fc9e00d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:40:37.800Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8322be43-eff0-46aa-b6bf-1a676fc9e00d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:40:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcbf3d77-ac02-4fda-b80b-199fe55ba6a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcbf3d77-ac02-4fda-b80b-199fe55ba6a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ce8048d 2021-04-14T11:40:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcbf3d77-ac02-4fda-b80b-199fe55ba6a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bcbf3d77-ac02-4fda-b80b-199fe55ba6a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:40.060Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bcbf3d77-ac02-4fda-b80b-199fe55ba6a5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:40:40.060Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bcbf3d77-ac02-4fda-b80b-199fe55ba6a5 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:40:41.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9facd7-21d8-4c7a-84e6-7a5df793dfd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:41.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9facd7-21d8-4c7a-84e6-7a5df793dfd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fff6b4d 2021-04-14T11:40:41.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9facd7-21d8-4c7a-84e6-7a5df793dfd4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:41.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9facd7-21d8-4c7a-84e6-7a5df793dfd4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:41.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=567406e5-8278-4d3f-b911-4e1a378d3ec7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:41.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=567406e5-8278-4d3f-b911-4e1a378d3ec7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19fa0c40 2021-04-14T11:40:41.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=567406e5-8278-4d3f-b911-4e1a378d3ec7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:41.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=567406e5-8278-4d3f-b911-4e1a378d3ec7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:42.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7641ae27-a0e9-44f4-991d-36cd58e4ff0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:42.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7641ae27-a0e9-44f4-991d-36cd58e4ff0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5aaaf9e 2021-04-14T11:40:42.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7641ae27-a0e9-44f4-991d-36cd58e4ff0b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:42.720Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7641ae27-a0e9-44f4-991d-36cd58e4ff0b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:44.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28639c7b-8e32-4e4f-8d95-f81974db83ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:44.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28639c7b-8e32-4e4f-8d95-f81974db83ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d99ca50 2021-04-14T11:40:44.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28639c7b-8e32-4e4f-8d95-f81974db83ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:44.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28639c7b-8e32-4e4f-8d95-f81974db83ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:40:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:40:47.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be44aa6e-a6b1-49c9-a647-74e8b1ff7efb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:47.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be44aa6e-a6b1-49c9-a647-74e8b1ff7efb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9387dad 2021-04-14T11:40:47.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be44aa6e-a6b1-49c9-a647-74e8b1ff7efb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:47.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be44aa6e-a6b1-49c9-a647-74e8b1ff7efb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:49.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3698075-7084-4fc8-920b-b6de1625099f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:49.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3698075-7084-4fc8-920b-b6de1625099f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4069f8c6 2021-04-14T11:40:49.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3698075-7084-4fc8-920b-b6de1625099f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:49.482Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3698075-7084-4fc8-920b-b6de1625099f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:50.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090f85c-2319-4bfc-b7be-86572f8392a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:50.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090f85c-2319-4bfc-b7be-86572f8392a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@106f790a 2021-04-14T11:40:50.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090f85c-2319-4bfc-b7be-86572f8392a2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:50.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0090f85c-2319-4bfc-b7be-86572f8392a2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:53.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a54faa07-aad1-43fd-a443-59a1a10e3b11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:53.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a54faa07-aad1-43fd-a443-59a1a10e3b11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53e7ea1d 2021-04-14T11:40:53.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a54faa07-aad1-43fd-a443-59a1a10e3b11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:53.958Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a54faa07-aad1-43fd-a443-59a1a10e3b11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:55.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9e7edf-bfed-463f-b2be-692e9d9202f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:55.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9e7edf-bfed-463f-b2be-692e9d9202f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@197830d9 2021-04-14T11:40:55.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9e7edf-bfed-463f-b2be-692e9d9202f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:55.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9e7edf-bfed-463f-b2be-692e9d9202f9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:56.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:40:56.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16d844f8 2021-04-14T11:40:56.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:40:56.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:40:59.961Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:40:59.962Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:40:59.962Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:40:59.962Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=83f7fded-5eb5-4339-94f6-7ca3f197741a ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:01.161Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a87fd95-15ac-4392-9f8c-d5f91a908c68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:01.161Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a87fd95-15ac-4392-9f8c-d5f91a908c68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d94d800 2021-04-14T11:41:01.161Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a87fd95-15ac-4392-9f8c-d5f91a908c68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:01.161Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a87fd95-15ac-4392-9f8c-d5f91a908c68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:04.174Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2a87fd95-15ac-4392-9f8c-d5f91a908c68 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:41:04.174Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2a87fd95-15ac-4392-9f8c-d5f91a908c68 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:41:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:41:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:41:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:41:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:41:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:41:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:41:04.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=183e7824-c73e-4eb4-911f-ea5ffdff6e78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:04.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=183e7824-c73e-4eb4-911f-ea5ffdff6e78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@496976b5 2021-04-14T11:41:04.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=183e7824-c73e-4eb4-911f-ea5ffdff6e78 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:04.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=183e7824-c73e-4eb4-911f-ea5ffdff6e78 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:05.303Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=183e7824-c73e-4eb4-911f-ea5ffdff6e78 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:05.303Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=183e7824-c73e-4eb4-911f-ea5ffdff6e78 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:05.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9475285-1c8e-4419-b355-ee4e91eabe02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:05.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9475285-1c8e-4419-b355-ee4e91eabe02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@464d8b84 2021-04-14T11:41:05.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9475285-1c8e-4419-b355-ee4e91eabe02 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:05.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9475285-1c8e-4419-b355-ee4e91eabe02 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:07.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb9f58c3-e574-4229-8b05-ea4db566f1cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:07.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb9f58c3-e574-4229-8b05-ea4db566f1cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c7d53ea 2021-04-14T11:41:07.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb9f58c3-e574-4229-8b05-ea4db566f1cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:07.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb9f58c3-e574-4229-8b05-ea4db566f1cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:08.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8271be9-ca80-44a2-92e2-7b8fedf570c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:08.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8271be9-ca80-44a2-92e2-7b8fedf570c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e23440e 2021-04-14T11:41:08.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8271be9-ca80-44a2-92e2-7b8fedf570c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:08.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8271be9-ca80-44a2-92e2-7b8fedf570c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:09.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e54d8764-58d2-47d7-9cea-9bc7f0e96828 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:09.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e54d8764-58d2-47d7-9cea-9bc7f0e96828 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23cb101a 2021-04-14T11:41:09.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e54d8764-58d2-47d7-9cea-9bc7f0e96828 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:09.774Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e54d8764-58d2-47d7-9cea-9bc7f0e96828 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:11.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d5449b2-bc21-4bac-a0fa-072e1268e9a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:11.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d5449b2-bc21-4bac-a0fa-072e1268e9a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9f0be4c 2021-04-14T11:41:11.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d5449b2-bc21-4bac-a0fa-072e1268e9a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:11.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d5449b2-bc21-4bac-a0fa-072e1268e9a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:13.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=951230ec-68cd-4a46-b621-8ccf68f8ac61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:13.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=951230ec-68cd-4a46-b621-8ccf68f8ac61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f544e9b 2021-04-14T11:41:13.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=951230ec-68cd-4a46-b621-8ccf68f8ac61 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:13.513Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=951230ec-68cd-4a46-b621-8ccf68f8ac61 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:15.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764b86ec-3ddf-48c6-8df9-8b74051026cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:15.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764b86ec-3ddf-48c6-8df9-8b74051026cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b63604b 2021-04-14T11:41:15.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764b86ec-3ddf-48c6-8df9-8b74051026cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:15.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=764b86ec-3ddf-48c6-8df9-8b74051026cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd212cc-2d2c-4843-acf7-0ccb9daa5b8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd212cc-2d2c-4843-acf7-0ccb9daa5b8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d3f4fd 2021-04-14T11:41:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd212cc-2d2c-4843-acf7-0ccb9daa5b8a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dd212cc-2d2c-4843-acf7-0ccb9daa5b8a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:20.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ff80e63-30a0-4f23-aacc-588f564d1cec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:20.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ff80e63-30a0-4f23-aacc-588f564d1cec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cdd2875 2021-04-14T11:41:20.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ff80e63-30a0-4f23-aacc-588f564d1cec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:20.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ff80e63-30a0-4f23-aacc-588f564d1cec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:24.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bcc5714-b0dd-477c-b3bb-900202a3b941 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:24.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bcc5714-b0dd-477c-b3bb-900202a3b941 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61909fe3 2021-04-14T11:41:24.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bcc5714-b0dd-477c-b3bb-900202a3b941 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:24.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bcc5714-b0dd-477c-b3bb-900202a3b941 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b40c5a7-6eda-4506-96ab-3d600a03afe3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b40c5a7-6eda-4506-96ab-3d600a03afe3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@111caa2 2021-04-14T11:41:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b40c5a7-6eda-4506-96ab-3d600a03afe3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:27.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b40c5a7-6eda-4506-96ab-3d600a03afe3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:30.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4dc3f63-11ea-4206-9bd9-aed9d55aa38e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:30.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4dc3f63-11ea-4206-9bd9-aed9d55aa38e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1efab261 2021-04-14T11:41:30.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4dc3f63-11ea-4206-9bd9-aed9d55aa38e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:30.441Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4dc3f63-11ea-4206-9bd9-aed9d55aa38e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:31.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:31.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c481b29a-362e-4cb4-bc0e-82879c94239c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c481b29a-362e-4cb4-bc0e-82879c94239c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b81af4b 2021-04-14T11:41:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c481b29a-362e-4cb4-bc0e-82879c94239c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c481b29a-362e-4cb4-bc0e-82879c94239c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1507c42e-0023-425f-baeb-fff5ce529321 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1507c42e-0023-425f-baeb-fff5ce529321 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e0b585f 2021-04-14T11:41:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1507c42e-0023-425f-baeb-fff5ce529321 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1507c42e-0023-425f-baeb-fff5ce529321 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:39.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:39.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1140c5e6 2021-04-14T11:41:39.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:39.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:42.537Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:41:42.538Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:41:42.538Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:42.538Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0acc69c3-be3f-4bde-8072-f7b630d0cb66 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:43.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14a80683-0821-495e-b346-ad42a974ecd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:43.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14a80683-0821-495e-b346-ad42a974ecd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ae21415 2021-04-14T11:41:43.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14a80683-0821-495e-b346-ad42a974ecd4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:43.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14a80683-0821-495e-b346-ad42a974ecd4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:41:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:41:46.229Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=14a80683-0821-495e-b346-ad42a974ecd4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:41:46.229Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=14a80683-0821-495e-b346-ad42a974ecd4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:41:47.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1803e75-43c9-4c0a-90d6-36aaec596206 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:47.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1803e75-43c9-4c0a-90d6-36aaec596206 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68626f97 2021-04-14T11:41:47.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1803e75-43c9-4c0a-90d6-36aaec596206 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:47.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1803e75-43c9-4c0a-90d6-36aaec596206 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:50.028Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f1803e75-43c9-4c0a-90d6-36aaec596206 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:50.028Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f1803e75-43c9-4c0a-90d6-36aaec596206 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:50.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:41:50.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@359209c2 2021-04-14T11:41:50.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:41:50.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:41:53.550Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:41:53.551Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:41:53.551Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:41:53.551Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=c4d905d5-3890-4ccf-b659-df0b534185ab ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:42:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:42:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:42:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:42:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:42:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:42:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:42:05.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3cef0af-f622-4f8d-a1f7-6d75e490eab4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:05.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3cef0af-f622-4f8d-a1f7-6d75e490eab4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6136442e 2021-04-14T11:42:05.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3cef0af-f622-4f8d-a1f7-6d75e490eab4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:05.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3cef0af-f622-4f8d-a1f7-6d75e490eab4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:08.539Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d3cef0af-f622-4f8d-a1f7-6d75e490eab4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:42:08.540Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d3cef0af-f622-4f8d-a1f7-6d75e490eab4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:42:09.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf49e35-b63b-4e1f-80cd-664785feeecf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:09.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf49e35-b63b-4e1f-80cd-664785feeecf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3225e432 2021-04-14T11:42:09.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf49e35-b63b-4e1f-80cd-664785feeecf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:09.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bf49e35-b63b-4e1f-80cd-664785feeecf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:15.391Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7bf49e35-b63b-4e1f-80cd-664785feeecf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:42:15.391Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7bf49e35-b63b-4e1f-80cd-664785feeecf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:42:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:16.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:24.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8462a710-0744-441c-a124-61ec23ecc5cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:24.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8462a710-0744-441c-a124-61ec23ecc5cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4498064c 2021-04-14T11:42:24.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8462a710-0744-441c-a124-61ec23ecc5cd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:24.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8462a710-0744-441c-a124-61ec23ecc5cd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:27.949Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8462a710-0744-441c-a124-61ec23ecc5cd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:42:27.950Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8462a710-0744-441c-a124-61ec23ecc5cd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:42:28.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d252778e-7d95-4372-a483-e72425232a4e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:28.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d252778e-7d95-4372-a483-e72425232a4e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f5e7e48 2021-04-14T11:42:28.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d252778e-7d95-4372-a483-e72425232a4e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:28.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d252778e-7d95-4372-a483-e72425232a4e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:31.542Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d252778e-7d95-4372-a483-e72425232a4e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:42:31.543Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d252778e-7d95-4372-a483-e72425232a4e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:42:32.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=166e2101-aadd-48b6-93e7-280fcd7b898d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:32.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=166e2101-aadd-48b6-93e7-280fcd7b898d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d670242 2021-04-14T11:42:32.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=166e2101-aadd-48b6-93e7-280fcd7b898d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:32.430Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=166e2101-aadd-48b6-93e7-280fcd7b898d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:35.439Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=166e2101-aadd-48b6-93e7-280fcd7b898d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:42:35.439Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=166e2101-aadd-48b6-93e7-280fcd7b898d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:42:36.269Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc71e98-5af9-4749-a180-2d501b1c0a64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:36.269Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc71e98-5af9-4749-a180-2d501b1c0a64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b68dc05 2021-04-14T11:42:36.269Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc71e98-5af9-4749-a180-2d501b1c0a64 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:36.269Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc71e98-5af9-4749-a180-2d501b1c0a64 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:37.264Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=794c5bfe-ee5a-45f6-8e5d-4e3f317c6487 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:42:37.263608Z InvocationID=64dc9f15-fd12-4be9-ba35-d2a81427eec9 LogTimestamp=2021-04-14T11:42:37.263923Z Entering 2021-04-14T11:42:37.265Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=794c5bfe-ee5a-45f6-8e5d-4e3f317c6487 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:42:37.263608Z InvocationID=64dc9f15-fd12-4be9-ba35-d2a81427eec9 LogTimestamp=2021-04-14T11:42:37.263923Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:42:37.270Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=4 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:42:37.265Z InvocationID=83742dfb-a18d-43d4-942e-ad62a98755fe LogTimestamp=2021-04-14T11:42:37.269978Z ResponseDesc=OK Exiting. 2021-04-14T11:42:37.270Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:42:39.279Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3fc71e98-5af9-4749-a180-2d501b1c0a64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:42:39.279Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3fc71e98-5af9-4749-a180-2d501b1c0a64 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:42:39.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6742d5f-4a88-4455-9405-1bb4283e68ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:39.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6742d5f-4a88-4455-9405-1bb4283e68ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@97ce729 2021-04-14T11:42:39.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6742d5f-4a88-4455-9405-1bb4283e68ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:39.454Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6742d5f-4a88-4455-9405-1bb4283e68ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:40.402Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e6742d5f-4a88-4455-9405-1bb4283e68ee ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:42:40.403Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e6742d5f-4a88-4455-9405-1bb4283e68ee ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:42:40.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d07362d-772c-40fe-8c83-acd5dd11ab87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:40.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d07362d-772c-40fe-8c83-acd5dd11ab87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21106159 2021-04-14T11:42:40.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d07362d-772c-40fe-8c83-acd5dd11ab87 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:40.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d07362d-772c-40fe-8c83-acd5dd11ab87 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:41.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=559f695c-5c36-4115-a6c4-f39d08694d74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:41.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=559f695c-5c36-4115-a6c4-f39d08694d74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59eb25d2 2021-04-14T11:42:41.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=559f695c-5c36-4115-a6c4-f39d08694d74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:41.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=559f695c-5c36-4115-a6c4-f39d08694d74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:41.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ebc935e-211a-4111-9b46-dc7161e99494 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:41.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ebc935e-211a-4111-9b46-dc7161e99494 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3740c469 2021-04-14T11:42:41.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ebc935e-211a-4111-9b46-dc7161e99494 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:41.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ebc935e-211a-4111-9b46-dc7161e99494 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:41.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04edbd27-d181-4c64-9ecf-7e7d84a45c4e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:41.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04edbd27-d181-4c64-9ecf-7e7d84a45c4e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a078d3 2021-04-14T11:42:41.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04edbd27-d181-4c64-9ecf-7e7d84a45c4e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:41.679Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04edbd27-d181-4c64-9ecf-7e7d84a45c4e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:41.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02352f64-c036-47dd-8855-fc00bb363f62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:42:41.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02352f64-c036-47dd-8855-fc00bb363f62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2198db57 2021-04-14T11:42:41.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02352f64-c036-47dd-8855-fc00bb363f62 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:42:41.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02352f64-c036-47dd-8855-fc00bb363f62 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:42:44.998Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=02352f64-c036-47dd-8855-fc00bb363f62 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:42:45.000Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=02352f64-c036-47dd-8855-fc00bb363f62 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:42:45.001Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=02352f64-c036-47dd-8855-fc00bb363f62 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:42:45.001Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=02352f64-c036-47dd-8855-fc00bb363f62 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:42:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:42:45.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:42:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:42:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:42:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:42:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:42:54.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:42:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:42:59.900Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:43:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:43:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:43:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:43:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:43:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:43:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:43:06.257Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c3e5877c-7693-4f25-9eb9-40622bb1c50f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:43:06.257321Z InvocationID=31e37d45-4d40-4bfa-813e-719f02780381 LogTimestamp=2021-04-14T11:43:06.257401Z Entering 2021-04-14T11:43:06.257Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c3e5877c-7693-4f25-9eb9-40622bb1c50f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:43:06.257321Z InvocationID=31e37d45-4d40-4bfa-813e-719f02780381 LogTimestamp=2021-04-14T11:43:06.257401Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:43:06.259Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:43:06.257Z InvocationID=7a5cfad4-919d-4d87-9362-7e35209ce444 LogTimestamp=2021-04-14T11:43:06.259260Z ResponseDesc=OK Exiting. 2021-04-14T11:43:06.259Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:43:13.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad84a8f8-1b4e-4e21-9db3-f4d22ea0a2da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:13.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad84a8f8-1b4e-4e21-9db3-f4d22ea0a2da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@215dbf03 2021-04-14T11:43:13.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad84a8f8-1b4e-4e21-9db3-f4d22ea0a2da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:13.751Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad84a8f8-1b4e-4e21-9db3-f4d22ea0a2da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:16.759Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ad84a8f8-1b4e-4e21-9db3-f4d22ea0a2da ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:16.760Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ad84a8f8-1b4e-4e21-9db3-f4d22ea0a2da ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:17.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e72be13d-f31c-40d5-b948-87ac1d739c8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:17.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e72be13d-f31c-40d5-b948-87ac1d739c8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1069c0ef 2021-04-14T11:43:17.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e72be13d-f31c-40d5-b948-87ac1d739c8b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:17.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e72be13d-f31c-40d5-b948-87ac1d739c8b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:20.640Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e72be13d-f31c-40d5-b948-87ac1d739c8b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:20.641Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e72be13d-f31c-40d5-b948-87ac1d739c8b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:21.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3286d252-0007-4a45-b019-254892cfe6ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:21.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3286d252-0007-4a45-b019-254892cfe6ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ba5ef9b 2021-04-14T11:43:21.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3286d252-0007-4a45-b019-254892cfe6ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:21.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3286d252-0007-4a45-b019-254892cfe6ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:24.116Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3286d252-0007-4a45-b019-254892cfe6ad ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:24.117Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3286d252-0007-4a45-b019-254892cfe6ad ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:24.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a802c9-fa1f-427d-9f79-864f580575d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:24.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a802c9-fa1f-427d-9f79-864f580575d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fd6b175 2021-04-14T11:43:24.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a802c9-fa1f-427d-9f79-864f580575d6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:24.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a802c9-fa1f-427d-9f79-864f580575d6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:27.845Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=29a802c9-fa1f-427d-9f79-864f580575d6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:27.846Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=29a802c9-fa1f-427d-9f79-864f580575d6 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:28.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9ab86b0-b5c6-411a-bad0-9b419eecfc67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:28.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9ab86b0-b5c6-411a-bad0-9b419eecfc67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bd9dc44 2021-04-14T11:43:28.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9ab86b0-b5c6-411a-bad0-9b419eecfc67 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:28.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9ab86b0-b5c6-411a-bad0-9b419eecfc67 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:31.929Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e9ab86b0-b5c6-411a-bad0-9b419eecfc67 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:31.929Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e9ab86b0-b5c6-411a-bad0-9b419eecfc67 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:32.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f54f432-c891-4b7c-af38-4d8f552271e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:32.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f54f432-c891-4b7c-af38-4d8f552271e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53520766 2021-04-14T11:43:32.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f54f432-c891-4b7c-af38-4d8f552271e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:32.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f54f432-c891-4b7c-af38-4d8f552271e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:35.949Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5f54f432-c891-4b7c-af38-4d8f552271e4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:35.950Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5f54f432-c891-4b7c-af38-4d8f552271e4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:36.261Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=39564199-8801-4407-882d-a921363b24a4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:43:36.260637Z InvocationID=1feb9eba-107a-4580-ad1a-b42650845234 LogTimestamp=2021-04-14T11:43:36.260798Z Entering 2021-04-14T11:43:36.261Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=39564199-8801-4407-882d-a921363b24a4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:43:36.260637Z InvocationID=1feb9eba-107a-4580-ad1a-b42650845234 LogTimestamp=2021-04-14T11:43:36.260798Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:43:36.265Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=4 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:43:36.261Z InvocationID=ec1e6831-2258-405a-9ff6-0f745b2b3b22 LogTimestamp=2021-04-14T11:43:36.265030Z ResponseDesc=OK Exiting. 2021-04-14T11:43:36.265Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:43:36.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe16e9f-56c1-4dd7-9e82-2c7c566a34ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:36.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe16e9f-56c1-4dd7-9e82-2c7c566a34ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@280eaae1 2021-04-14T11:43:36.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe16e9f-56c1-4dd7-9e82-2c7c566a34ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:36.498Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe16e9f-56c1-4dd7-9e82-2c7c566a34ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:39.513Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=dbe16e9f-56c1-4dd7-9e82-2c7c566a34ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:39.514Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=dbe16e9f-56c1-4dd7-9e82-2c7c566a34ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:40.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f901481-1d3b-4e25-bd67-d3010ae72180 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:40.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f901481-1d3b-4e25-bd67-d3010ae72180 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28a30652 2021-04-14T11:43:40.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f901481-1d3b-4e25-bd67-d3010ae72180 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:40.243Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f901481-1d3b-4e25-bd67-d3010ae72180 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:43.252Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5f901481-1d3b-4e25-bd67-d3010ae72180 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:43.253Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5f901481-1d3b-4e25-bd67-d3010ae72180 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:43:46.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:43:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d4fa67-83ed-4922-9c00-d884c28cbfa2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d4fa67-83ed-4922-9c00-d884c28cbfa2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b3e4f6d 2021-04-14T11:43:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d4fa67-83ed-4922-9c00-d884c28cbfa2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:48.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d4fa67-83ed-4922-9c00-d884c28cbfa2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:51.253Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=39d4fa67-83ed-4922-9c00-d884c28cbfa2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:51.254Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=39d4fa67-83ed-4922-9c00-d884c28cbfa2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:52.762Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7a10eb-a980-48ff-8ed4-672ae5026d51 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:52.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7a10eb-a980-48ff-8ed4-672ae5026d51 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a1c2bae 2021-04-14T11:43:52.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7a10eb-a980-48ff-8ed4-672ae5026d51 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:52.763Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b7a10eb-a980-48ff-8ed4-672ae5026d51 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:55.776Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1b7a10eb-a980-48ff-8ed4-672ae5026d51 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:55.776Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1b7a10eb-a980-48ff-8ed4-672ae5026d51 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:56.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=117a851b-6f77-4349-8ce3-2721c0613727 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:56.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=117a851b-6f77-4349-8ce3-2721c0613727 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@707ef200 2021-04-14T11:43:56.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=117a851b-6f77-4349-8ce3-2721c0613727 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:56.392Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=117a851b-6f77-4349-8ce3-2721c0613727 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:43:59.410Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=117a851b-6f77-4349-8ce3-2721c0613727 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:43:59.410Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=117a851b-6f77-4349-8ce3-2721c0613727 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:43:59.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9809d100-4822-4149-9e53-a77da31bd168 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:43:59.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9809d100-4822-4149-9e53-a77da31bd168 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4863557d 2021-04-14T11:43:59.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9809d100-4822-4149-9e53-a77da31bd168 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:43:59.576Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9809d100-4822-4149-9e53-a77da31bd168 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:01.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:01.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:01.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:02.588Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9809d100-4822-4149-9e53-a77da31bd168 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:02.588Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9809d100-4822-4149-9e53-a77da31bd168 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:03.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1561a780-781b-42ab-bf34-c7c54ea12cfd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:03.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1561a780-781b-42ab-bf34-c7c54ea12cfd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ce8244 2021-04-14T11:44:03.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1561a780-781b-42ab-bf34-c7c54ea12cfd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:03.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1561a780-781b-42ab-bf34-c7c54ea12cfd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:44:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:44:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:44:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:44:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:44:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:44:06.263Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=79ef9d7d-674e-4024-888f-54b689c1b55f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:44:06.262833Z InvocationID=1475a7f8-dca0-4679-bbae-65b218bff82c LogTimestamp=2021-04-14T11:44:06.263029Z Entering 2021-04-14T11:44:06.263Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=79ef9d7d-674e-4024-888f-54b689c1b55f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:44:06.262833Z InvocationID=1475a7f8-dca0-4679-bbae-65b218bff82c LogTimestamp=2021-04-14T11:44:06.263029Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:44:06.267Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:44:06.264Z InvocationID=10f8e2b1-a14e-455d-a82d-a37ae712ab33 LogTimestamp=2021-04-14T11:44:06.266964Z ResponseDesc=OK Exiting. 2021-04-14T11:44:06.267Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:44:06.641Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1561a780-781b-42ab-bf34-c7c54ea12cfd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:06.642Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1561a780-781b-42ab-bf34-c7c54ea12cfd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:07.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e055f33-bff3-4794-8b37-e038e1905759 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:07.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e055f33-bff3-4794-8b37-e038e1905759 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@792baf09 2021-04-14T11:44:07.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e055f33-bff3-4794-8b37-e038e1905759 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:07.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e055f33-bff3-4794-8b37-e038e1905759 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:10.407Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3e055f33-bff3-4794-8b37-e038e1905759 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:10.407Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3e055f33-bff3-4794-8b37-e038e1905759 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:11.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a390d9-b3f0-4c8a-afb3-509775e946a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:11.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a390d9-b3f0-4c8a-afb3-509775e946a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@362f4f46 2021-04-14T11:44:11.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a390d9-b3f0-4c8a-afb3-509775e946a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:11.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a390d9-b3f0-4c8a-afb3-509775e946a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:14.240Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b5a390d9-b3f0-4c8a-afb3-509775e946a0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:14.241Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b5a390d9-b3f0-4c8a-afb3-509775e946a0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:14.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6709f9-8eb5-43f1-888e-cb1a1f99353c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:14.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6709f9-8eb5-43f1-888e-cb1a1f99353c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3731049d 2021-04-14T11:44:14.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6709f9-8eb5-43f1-888e-cb1a1f99353c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:14.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be6709f9-8eb5-43f1-888e-cb1a1f99353c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:16.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:17.949Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=be6709f9-8eb5-43f1-888e-cb1a1f99353c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:17.950Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=be6709f9-8eb5-43f1-888e-cb1a1f99353c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:19.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d26922e9-aa62-4119-ad42-1fb30b46c8fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:19.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d26922e9-aa62-4119-ad42-1fb30b46c8fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52c91251 2021-04-14T11:44:19.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d26922e9-aa62-4119-ad42-1fb30b46c8fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:19.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d26922e9-aa62-4119-ad42-1fb30b46c8fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:22.964Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d26922e9-aa62-4119-ad42-1fb30b46c8fa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:22.965Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d26922e9-aa62-4119-ad42-1fb30b46c8fa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:24.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698721da-05b4-4448-904a-a53ca30f5d05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:24.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698721da-05b4-4448-904a-a53ca30f5d05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b93530f 2021-04-14T11:44:24.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698721da-05b4-4448-904a-a53ca30f5d05 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:24.258Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=698721da-05b4-4448-904a-a53ca30f5d05 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:27.267Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=698721da-05b4-4448-904a-a53ca30f5d05 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:27.267Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=698721da-05b4-4448-904a-a53ca30f5d05 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:27.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c6a0dd-8319-487f-bb63-b672f32e9d2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:27.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c6a0dd-8319-487f-bb63-b672f32e9d2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e40272f 2021-04-14T11:44:27.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c6a0dd-8319-487f-bb63-b672f32e9d2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:27.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c6a0dd-8319-487f-bb63-b672f32e9d2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:30.820Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=39c6a0dd-8319-487f-bb63-b672f32e9d2d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:30.820Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=39c6a0dd-8319-487f-bb63-b672f32e9d2d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:36.251Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ef76c843-2e79-4b2b-9602-c268cd0f9f30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:44:36.250624Z InvocationID=645a429d-e369-4384-9210-16086f42f812 LogTimestamp=2021-04-14T11:44:36.250699Z Entering 2021-04-14T11:44:36.251Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ef76c843-2e79-4b2b-9602-c268cd0f9f30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:44:36.250624Z InvocationID=645a429d-e369-4384-9210-16086f42f812 LogTimestamp=2021-04-14T11:44:36.250699Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:44:36.253Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:44:36.251Z InvocationID=97c42492-e291-4ec9-91d1-b8035e360299 LogTimestamp=2021-04-14T11:44:36.252995Z ResponseDesc=OK Exiting. 2021-04-14T11:44:36.253Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:44:36.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=810b076b-948a-4ddb-a806-f751ccc1897f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:36.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=810b076b-948a-4ddb-a806-f751ccc1897f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26bd622a 2021-04-14T11:44:36.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=810b076b-948a-4ddb-a806-f751ccc1897f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:36.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=810b076b-948a-4ddb-a806-f751ccc1897f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:39.590Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=810b076b-948a-4ddb-a806-f751ccc1897f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:39.590Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=810b076b-948a-4ddb-a806-f751ccc1897f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:40.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fcba87e-393a-49e7-a0d2-150e25f5c70c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:40.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fcba87e-393a-49e7-a0d2-150e25f5c70c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32326185 2021-04-14T11:44:40.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fcba87e-393a-49e7-a0d2-150e25f5c70c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:40.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5fcba87e-393a-49e7-a0d2-150e25f5c70c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:43.950Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5fcba87e-393a-49e7-a0d2-150e25f5c70c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:43.951Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5fcba87e-393a-49e7-a0d2-150e25f5c70c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:44:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:44:47.061Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12cc3275-b135-4cf9-acf4-9ba96a9551dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:47.061Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12cc3275-b135-4cf9-acf4-9ba96a9551dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@329eaa8a 2021-04-14T11:44:47.061Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12cc3275-b135-4cf9-acf4-9ba96a9551dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:47.061Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12cc3275-b135-4cf9-acf4-9ba96a9551dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:50.073Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=12cc3275-b135-4cf9-acf4-9ba96a9551dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:50.074Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=12cc3275-b135-4cf9-acf4-9ba96a9551dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9f66f40-60d4-497c-92bf-4741462c4e86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9f66f40-60d4-497c-92bf-4741462c4e86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c187090 2021-04-14T11:44:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9f66f40-60d4-497c-92bf-4741462c4e86 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:52.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9f66f40-60d4-497c-92bf-4741462c4e86 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:55.111Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f9f66f40-60d4-497c-92bf-4741462c4e86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:55.111Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f9f66f40-60d4-497c-92bf-4741462c4e86 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:44:56.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=199dec5a-fe2b-48a1-986e-3a1c424e31f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:44:56.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=199dec5a-fe2b-48a1-986e-3a1c424e31f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@db7a79a 2021-04-14T11:44:56.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=199dec5a-fe2b-48a1-986e-3a1c424e31f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:44:56.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=199dec5a-fe2b-48a1-986e-3a1c424e31f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:44:59.740Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=199dec5a-fe2b-48a1-986e-3a1c424e31f4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:44:59.741Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=199dec5a-fe2b-48a1-986e-3a1c424e31f4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:45:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:45:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:45:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:45:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:45:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:45:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:45:05.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ab4c8da-69ab-4dc4-b034-668d1365c1ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:45:05.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ab4c8da-69ab-4dc4-b034-668d1365c1ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5721fb5c 2021-04-14T11:45:05.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ab4c8da-69ab-4dc4-b034-668d1365c1ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:45:05.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ab4c8da-69ab-4dc4-b034-668d1365c1ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:45:06.243Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=90291f36-5c50-42bc-8e8d-0384999293f5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:45:06.243080Z InvocationID=95b6221e-7c72-446b-a484-56ab2975d113 LogTimestamp=2021-04-14T11:45:06.243245Z Entering 2021-04-14T11:45:06.243Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=90291f36-5c50-42bc-8e8d-0384999293f5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:45:06.243080Z InvocationID=95b6221e-7c72-446b-a484-56ab2975d113 LogTimestamp=2021-04-14T11:45:06.243245Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:45:06.247Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:45:06.244Z InvocationID=ee7f2b9c-3bad-461d-a2f4-ba162045952c LogTimestamp=2021-04-14T11:45:06.247073Z ResponseDesc=OK Exiting. 2021-04-14T11:45:06.247Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:45:08.547Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8ab4c8da-69ab-4dc4-b034-668d1365c1ba ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:45:08.547Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8ab4c8da-69ab-4dc4-b034-668d1365c1ba ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:45:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:45:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:45:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:45:26.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8e5a7d-b1aa-478b-9e88-9207c6bcb7ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:45:26.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8e5a7d-b1aa-478b-9e88-9207c6bcb7ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79cbad30 2021-04-14T11:45:26.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8e5a7d-b1aa-478b-9e88-9207c6bcb7ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:45:26.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c8e5a7d-b1aa-478b-9e88-9207c6bcb7ac PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:45:26.941Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:45:29.350Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7c8e5a7d-b1aa-478b-9e88-9207c6bcb7ac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:45:29.351Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7c8e5a7d-b1aa-478b-9e88-9207c6bcb7ac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:45:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:36.242Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c00cafa2-058d-4ccf-9198-8ea237fb6ff0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:45:36.241340Z InvocationID=43ce4b14-055b-446f-a7b3-79da96a8d05b LogTimestamp=2021-04-14T11:45:36.241432Z Entering 2021-04-14T11:45:36.242Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c00cafa2-058d-4ccf-9198-8ea237fb6ff0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:45:36.241340Z InvocationID=43ce4b14-055b-446f-a7b3-79da96a8d05b LogTimestamp=2021-04-14T11:45:36.241432Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:45:36.245Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:45:36.242Z InvocationID=03e1b1fa-cdd2-4e52-8c80-04b01c0b08e7 LogTimestamp=2021-04-14T11:45:36.245298Z ResponseDesc=OK Exiting. 2021-04-14T11:45:36.245Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:45:36.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8386affb-9e25-4802-90a0-5d2ccc5e6972 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:45:36.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8386affb-9e25-4802-90a0-5d2ccc5e6972 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6df7cb02 2021-04-14T11:45:36.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8386affb-9e25-4802-90a0-5d2ccc5e6972 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:45:36.342Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8386affb-9e25-4802-90a0-5d2ccc5e6972 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:45:39.350Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8386affb-9e25-4802-90a0-5d2ccc5e6972 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:45:39.351Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8386affb-9e25-4802-90a0-5d2ccc5e6972 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:45:40.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32b797ec-ef6b-49f6-b92e-73bcc91bdeb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:45:40.673Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32b797ec-ef6b-49f6-b92e-73bcc91bdeb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20d2a43 2021-04-14T11:45:40.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32b797ec-ef6b-49f6-b92e-73bcc91bdeb3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:45:40.674Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32b797ec-ef6b-49f6-b92e-73bcc91bdeb3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:45:43.683Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=32b797ec-ef6b-49f6-b92e-73bcc91bdeb3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:45:43.684Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=32b797ec-ef6b-49f6-b92e-73bcc91bdeb3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:45:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:45:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:45:50.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7ee5a43-b8a4-4759-9077-59c3ee2e4ea4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:45:50.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7ee5a43-b8a4-4759-9077-59c3ee2e4ea4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@455ea2a5 2021-04-14T11:45:50.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7ee5a43-b8a4-4759-9077-59c3ee2e4ea4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:45:50.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7ee5a43-b8a4-4759-9077-59c3ee2e4ea4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:45:53.342Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d7ee5a43-b8a4-4759-9077-59c3ee2e4ea4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:45:53.342Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d7ee5a43-b8a4-4759-9077-59c3ee2e4ea4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:46:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:01.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:03.913Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:03.913Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:46:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:46:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:46:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:46:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:46:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:46:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:46:04.915Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:05.915Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:06.249Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0b00ed04-e2da-4fbf-9322-416bf619ba09 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:46:06.249243Z InvocationID=f655ecff-9966-4d2c-929b-3c7e8b249f54 LogTimestamp=2021-04-14T11:46:06.249369Z Entering 2021-04-14T11:46:06.249Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0b00ed04-e2da-4fbf-9322-416bf619ba09 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:46:06.249243Z InvocationID=f655ecff-9966-4d2c-929b-3c7e8b249f54 LogTimestamp=2021-04-14T11:46:06.249369Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:46:06.250Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:46:06.250Z InvocationID=c48ee69e-cb9f-4890-aaa8-7e74f1d30e4f ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:46:06.251Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:46:06.251Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:46:06.250Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=c48ee69e-cb9f-4890-aaa8-7e74f1d30e4f ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@26daf43b 2021-04-14T11:46:06.251Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:46:06.251Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:46:06.250Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=c48ee69e-cb9f-4890-aaa8-7e74f1d30e4f ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@26daf43b 2021-04-14T11:46:06.252Z [qtp580718781-16] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:46:06.252367Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:46:06.252Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:46:06.252367Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:46:06.252Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:46:06.916Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:07.916Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:09.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:12.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:15.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:16.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:20.829Z [cluster1-nio-worker-1] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:46:20.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e1d0eed-157a-4eec-861b-aefbbac47ed2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:20.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e1d0eed-157a-4eec-861b-aefbbac47ed2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55969efd 2021-04-14T11:46:20.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e1d0eed-157a-4eec-861b-aefbbac47ed2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:20.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e1d0eed-157a-4eec-861b-aefbbac47ed2 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:24.136Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=8e1d0eed-157a-4eec-861b-aefbbac47ed2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:46:24.136Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=8e1d0eed-157a-4eec-861b-aefbbac47ed2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:46:24.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:24.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@656accee 2021-04-14T11:46:24.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:24.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:29.322Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:46:29.322Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:46:29.322Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:46:29.323Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=d27cda9f-e55a-43fa-962e-47ab1914d639 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:46:29.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d036553b-871a-4cf4-a089-6625a8a12b9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:29.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d036553b-871a-4cf4-a089-6625a8a12b9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dc3ea2c 2021-04-14T11:46:29.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d036553b-871a-4cf4-a089-6625a8a12b9f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:29.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d036553b-871a-4cf4-a089-6625a8a12b9f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:32.994Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d036553b-871a-4cf4-a089-6625a8a12b9f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:46:32.994Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d036553b-871a-4cf4-a089-6625a8a12b9f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:46:33.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde69919-a94f-4ca7-972e-8f52722ab518 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:33.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde69919-a94f-4ca7-972e-8f52722ab518 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@430a753c 2021-04-14T11:46:33.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde69919-a94f-4ca7-972e-8f52722ab518 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:33.518Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fde69919-a94f-4ca7-972e-8f52722ab518 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:33.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:36.239Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=34e9a932-2137-4688-83a3-9770b318e2a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:46:36.238427Z InvocationID=cfd441a0-9c12-4c00-8a85-f6663c11ac1c LogTimestamp=2021-04-14T11:46:36.238543Z Entering 2021-04-14T11:46:36.239Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=34e9a932-2137-4688-83a3-9770b318e2a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:46:36.238427Z InvocationID=cfd441a0-9c12-4c00-8a85-f6663c11ac1c LogTimestamp=2021-04-14T11:46:36.238543Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:46:36.239Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:46:36.239Z InvocationID=2b15f750-7acd-4cfe-bbf7-0d81d1e10f5e ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:46:36.240Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:46:36.240Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:46:36.239Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=2b15f750-7acd-4cfe-bbf7-0d81d1e10f5e ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@4dfa22f7 2021-04-14T11:46:36.240Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:46:36.240Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:46:36.239Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=2b15f750-7acd-4cfe-bbf7-0d81d1e10f5e ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@4dfa22f7 2021-04-14T11:46:36.240Z [qtp580718781-15] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:46:36.240663Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:46:36.240Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:46:36.240663Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:46:36.241Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:46:36.537Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fde69919-a94f-4ca7-972e-8f52722ab518 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:46:36.538Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fde69919-a94f-4ca7-972e-8f52722ab518 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:46:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:37.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a1758a-0606-474d-803c-8fa536f76294 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:37.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a1758a-0606-474d-803c-8fa536f76294 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@221b895f 2021-04-14T11:46:37.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a1758a-0606-474d-803c-8fa536f76294 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:37.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0a1758a-0606-474d-803c-8fa536f76294 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:40.569Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e0a1758a-0606-474d-803c-8fa536f76294 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:46:40.569Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e0a1758a-0606-474d-803c-8fa536f76294 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:46:40.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce504a8c-eadd-4dd9-9310-43a34dbc8546 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:40.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce504a8c-eadd-4dd9-9310-43a34dbc8546 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6499c852 2021-04-14T11:46:40.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce504a8c-eadd-4dd9-9310-43a34dbc8546 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:40.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce504a8c-eadd-4dd9-9310-43a34dbc8546 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:44.376Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ce504a8c-eadd-4dd9-9310-43a34dbc8546 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:46:44.377Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ce504a8c-eadd-4dd9-9310-43a34dbc8546 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:46:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57b2efe-1474-43be-a0ac-221432e7978b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57b2efe-1474-43be-a0ac-221432e7978b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@565eb6fc 2021-04-14T11:46:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57b2efe-1474-43be-a0ac-221432e7978b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f57b2efe-1474-43be-a0ac-221432e7978b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:45.249Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:46:45.250Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 2000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:46:45.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:46:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:46:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:52.534Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f57b2efe-1474-43be-a0ac-221432e7978b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:46:52.534Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f57b2efe-1474-43be-a0ac-221432e7978b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:46:53.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fbb215d-7011-4a3e-ac3e-5e4a70dc90a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:53.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fbb215d-7011-4a3e-ac3e-5e4a70dc90a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f2518e9 2021-04-14T11:46:53.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fbb215d-7011-4a3e-ac3e-5e4a70dc90a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:53.338Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fbb215d-7011-4a3e-ac3e-5e4a70dc90a7 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:56.349Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0fbb215d-7011-4a3e-ac3e-5e4a70dc90a7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:46:56.349Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0fbb215d-7011-4a3e-ac3e-5e4a70dc90a7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:46:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95e80c7-43f8-48f4-a10e-344f6d2a06f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:46:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95e80c7-43f8-48f4-a10e-344f6d2a06f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58a4af75 2021-04-14T11:46:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95e80c7-43f8-48f4-a10e-344f6d2a06f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:46:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95e80c7-43f8-48f4-a10e-344f6d2a06f2 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:46:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:46:59.907Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c95e80c7-43f8-48f4-a10e-344f6d2a06f2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:46:59.907Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c95e80c7-43f8-48f4-a10e-344f6d2a06f2 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:00.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d52dfcf-df10-4000-8cc7-bb0884e98e7e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:00.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d52dfcf-df10-4000-8cc7-bb0884e98e7e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e9e24fd 2021-04-14T11:47:00.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d52dfcf-df10-4000-8cc7-bb0884e98e7e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:00.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d52dfcf-df10-4000-8cc7-bb0884e98e7e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:03.080Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5d52dfcf-df10-4000-8cc7-bb0884e98e7e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:03.081Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5d52dfcf-df10-4000-8cc7-bb0884e98e7e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:03.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d169b2e7-79ad-4ba5-8569-f4bf7cbf8d2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:03.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d169b2e7-79ad-4ba5-8569-f4bf7cbf8d2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8a4e1c1 2021-04-14T11:47:03.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d169b2e7-79ad-4ba5-8569-f4bf7cbf8d2a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:03.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d169b2e7-79ad-4ba5-8569-f4bf7cbf8d2a PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:47:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:47:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:47:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:47:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:47:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:47:06.243Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9f4d38a1-354e-4b93-bee1-d71a5bb83a21 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:47:06.243017Z InvocationID=b301b177-6030-445b-b0b5-c59bbf7905e9 LogTimestamp=2021-04-14T11:47:06.243094Z Entering 2021-04-14T11:47:06.243Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9f4d38a1-354e-4b93-bee1-d71a5bb83a21 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:47:06.243017Z InvocationID=b301b177-6030-445b-b0b5-c59bbf7905e9 LogTimestamp=2021-04-14T11:47:06.243094Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:47:06.244Z [qtp580718781-19] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:47:06.243Z InvocationID=935b2e8b-adbc-413a-80ab-db9763f94e08 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:47:06.245Z [qtp580718781-19] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=2 EndTimestamp=2021-04-14T11:47:06.245Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:47:06.243Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=935b2e8b-adbc-413a-80ab-db9763f94e08 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@2d366cc6 2021-04-14T11:47:06.245Z [qtp580718781-19] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=2 EndTimestamp=2021-04-14T11:47:06.245Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:47:06.243Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=935b2e8b-adbc-413a-80ab-db9763f94e08 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@2d366cc6 2021-04-14T11:47:06.245Z [qtp580718781-19] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:47:06.245884Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:47:06.246Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:47:06.245884Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:47:06.246Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:47:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:06.823Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d169b2e7-79ad-4ba5-8569-f4bf7cbf8d2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:06.823Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d169b2e7-79ad-4ba5-8569-f4bf7cbf8d2a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:07.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d15f4b9-ad8b-4f43-b208-0e529bada2dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:07.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d15f4b9-ad8b-4f43-b208-0e529bada2dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52f71186 2021-04-14T11:47:07.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d15f4b9-ad8b-4f43-b208-0e529bada2dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:07.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d15f4b9-ad8b-4f43-b208-0e529bada2dc PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:09.815Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:10.410Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0d15f4b9-ad8b-4f43-b208-0e529bada2dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:10.410Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0d15f4b9-ad8b-4f43-b208-0e529bada2dc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:10.867Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:47:10.868Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 4000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:47:11.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee9c6b34-f733-4baa-a9e2-c218eb2d4efe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:11.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee9c6b34-f733-4baa-a9e2-c218eb2d4efe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3908cb9d 2021-04-14T11:47:11.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee9c6b34-f733-4baa-a9e2-c218eb2d4efe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:11.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee9c6b34-f733-4baa-a9e2-c218eb2d4efe PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:14.125Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ee9c6b34-f733-4baa-a9e2-c218eb2d4efe ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:14.125Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ee9c6b34-f733-4baa-a9e2-c218eb2d4efe ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:14.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3653b152-3f3e-47eb-9d4c-36a88de400cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:14.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3653b152-3f3e-47eb-9d4c-36a88de400cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f6357f 2021-04-14T11:47:14.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3653b152-3f3e-47eb-9d4c-36a88de400cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:14.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3653b152-3f3e-47eb-9d4c-36a88de400cc PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:17.429Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3653b152-3f3e-47eb-9d4c-36a88de400cc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:17.429Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3653b152-3f3e-47eb-9d4c-36a88de400cc ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1976c0cd-7b0d-49e5-8f18-3b46a435c1f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1976c0cd-7b0d-49e5-8f18-3b46a435c1f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f9b9cb 2021-04-14T11:47:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1976c0cd-7b0d-49e5-8f18-3b46a435c1f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:17.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1976c0cd-7b0d-49e5-8f18-3b46a435c1f1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:20.993Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=1976c0cd-7b0d-49e5-8f18-3b46a435c1f1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:20.993Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=1976c0cd-7b0d-49e5-8f18-3b46a435c1f1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:21.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fecdf8f-4cde-4188-8b9c-61e5ff5779f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:21.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fecdf8f-4cde-4188-8b9c-61e5ff5779f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60b2970b 2021-04-14T11:47:21.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fecdf8f-4cde-4188-8b9c-61e5ff5779f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:21.165Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fecdf8f-4cde-4188-8b9c-61e5ff5779f4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:24.177Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3fecdf8f-4cde-4188-8b9c-61e5ff5779f4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:24.178Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3fecdf8f-4cde-4188-8b9c-61e5ff5779f4 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:24.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041658ae-1b86-44f1-ac95-107b6b21a061 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:24.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041658ae-1b86-44f1-ac95-107b6b21a061 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@447f3b31 2021-04-14T11:47:24.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041658ae-1b86-44f1-ac95-107b6b21a061 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:24.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=041658ae-1b86-44f1-ac95-107b6b21a061 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:27.921Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=041658ae-1b86-44f1-ac95-107b6b21a061 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:27.921Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=041658ae-1b86-44f1-ac95-107b6b21a061 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:28.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58ac702-7a6d-4b29-bcab-eae469ff51ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:28.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58ac702-7a6d-4b29-bcab-eae469ff51ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cbf404d 2021-04-14T11:47:28.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58ac702-7a6d-4b29-bcab-eae469ff51ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:28.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58ac702-7a6d-4b29-bcab-eae469ff51ac PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:31.609Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e58ac702-7a6d-4b29-bcab-eae469ff51ac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:31.609Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e58ac702-7a6d-4b29-bcab-eae469ff51ac ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:32.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e1940c-6e98-498f-9b1b-31cba56f3ff1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:32.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e1940c-6e98-498f-9b1b-31cba56f3ff1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27668198 2021-04-14T11:47:32.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e1940c-6e98-498f-9b1b-31cba56f3ff1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:32.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70e1940c-6e98-498f-9b1b-31cba56f3ff1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:35.321Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=70e1940c-6e98-498f-9b1b-31cba56f3ff1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:35.321Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=70e1940c-6e98-498f-9b1b-31cba56f3ff1 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94ce4d69-eb1a-4a41-ab14-64c75c0e55ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94ce4d69-eb1a-4a41-ab14-64c75c0e55ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@257c3d64 2021-04-14T11:47:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94ce4d69-eb1a-4a41-ab14-64c75c0e55ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94ce4d69-eb1a-4a41-ab14-64c75c0e55ad PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:36.233Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=47eb9139-a213-4482-a362-a3da3be41bd8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:47:36.233323Z InvocationID=5ec60816-806f-450b-b7cd-b21c269d47a2 LogTimestamp=2021-04-14T11:47:36.233454Z Entering 2021-04-14T11:47:36.234Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=47eb9139-a213-4482-a362-a3da3be41bd8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:47:36.233323Z InvocationID=5ec60816-806f-450b-b7cd-b21c269d47a2 LogTimestamp=2021-04-14T11:47:36.233454Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:47:36.234Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:47:36.234Z InvocationID=b4afa2a3-e7c5-4e21-a3f6-0b4107ff343b ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:47:36.235Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:47:36.235Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:47:36.234Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b4afa2a3-e7c5-4e21-a3f6-0b4107ff343b ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@ed636e 2021-04-14T11:47:36.235Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:47:36.235Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:47:36.234Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b4afa2a3-e7c5-4e21-a3f6-0b4107ff343b ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@ed636e 2021-04-14T11:47:36.235Z [qtp580718781-16] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:47:36.235824Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:47:36.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:47:36.235824Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:47:36.236Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:47:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:39.012Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=94ce4d69-eb1a-4a41-ab14-64c75c0e55ad ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:39.013Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=94ce4d69-eb1a-4a41-ab14-64c75c0e55ad ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:39.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d47cb0fa-f3b5-4bd7-bcbc-eda68d4fb3e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:39.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d47cb0fa-f3b5-4bd7-bcbc-eda68d4fb3e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40347001 2021-04-14T11:47:39.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d47cb0fa-f3b5-4bd7-bcbc-eda68d4fb3e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:39.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d47cb0fa-f3b5-4bd7-bcbc-eda68d4fb3e9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:42.221Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d47cb0fa-f3b5-4bd7-bcbc-eda68d4fb3e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:42.221Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d47cb0fa-f3b5-4bd7-bcbc-eda68d4fb3e9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:42.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4a7f86-b1ab-4923-9b17-c1a2ffd49c37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:42.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4a7f86-b1ab-4923-9b17-c1a2ffd49c37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a1df96a 2021-04-14T11:47:42.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4a7f86-b1ab-4923-9b17-c1a2ffd49c37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:42.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e4a7f86-b1ab-4923-9b17-c1a2ffd49c37 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:45.641Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7e4a7f86-b1ab-4923-9b17-c1a2ffd49c37 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:45.641Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7e4a7f86-b1ab-4923-9b17-c1a2ffd49c37 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:47:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:47:46.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add4f9b5-a3df-4e96-aa42-bd8f2c7cc370 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:46.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add4f9b5-a3df-4e96-aa42-bd8f2c7cc370 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b32b44 2021-04-14T11:47:46.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add4f9b5-a3df-4e96-aa42-bd8f2c7cc370 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:46.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add4f9b5-a3df-4e96-aa42-bd8f2c7cc370 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:48.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:48.918Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d48840a8-7371-4450-82bb-107443a55af8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:47:48.917407Z InvocationID=cdb169fb-cf2f-4781-9d10-6ef6a2e874d0 LogTimestamp=2021-04-14T11:47:48.917490Z Entering 2021-04-14T11:47:48.918Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d48840a8-7371-4450-82bb-107443a55af8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:47:48.917407Z InvocationID=cdb169fb-cf2f-4781-9d10-6ef6a2e874d0 LogTimestamp=2021-04-14T11:47:48.917490Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:47:48.918Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:47:48.918Z InvocationID=24966cff-c95f-4a19-ad64-221236dad2ca ErrorCode=500 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:47:48.919Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=clamp ElapsedTime=0 EndTimestamp=2021-04-14T11:47:48.918Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.228.190 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:47:48.918Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=24966cff-c95f-4a19-ad64-221236dad2ca ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@5bb7bba1 2021-04-14T11:47:48.919Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=clamp ElapsedTime=0 EndTimestamp=2021-04-14T11:47:48.918Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.228.190 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:47:48.918Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=24966cff-c95f-4a19-ad64-221236dad2ca ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@5bb7bba1 2021-04-14T11:47:48.919Z [qtp580718781-15] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:47:48.919483Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:47:48.919Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:47:48.919483Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:47:48.919Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:47:49.688Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=add4f9b5-a3df-4e96-aa42-bd8f2c7cc370 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:49.689Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=add4f9b5-a3df-4e96-aa42-bd8f2c7cc370 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:50.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7fda69-fc34-46e1-8506-c7b2256b5027 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:50.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7fda69-fc34-46e1-8506-c7b2256b5027 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5875b159 2021-04-14T11:47:50.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7fda69-fc34-46e1-8506-c7b2256b5027 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:50.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7fda69-fc34-46e1-8506-c7b2256b5027 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:50.472Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396) at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51) at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512) at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190) at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194) at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68) at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54) at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44) at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66) at com.google.common.collect.Iterables$4.iterator(Iterables.java:559) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:84) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:47:50.472Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation ErrorCategory=INFO RequestID=null ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1670) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:832) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:47:50.871Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:47:50.871Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 16000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:47:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:53.238Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7d7fda69-fc34-46e1-8506-c7b2256b5027 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:53.239Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7d7fda69-fc34-46e1-8506-c7b2256b5027 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3a64c75-3832-4aa8-8bff-02419c41dfa9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3a64c75-3832-4aa8-8bff-02419c41dfa9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57f062b 2021-04-14T11:47:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3a64c75-3832-4aa8-8bff-02419c41dfa9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3a64c75-3832-4aa8-8bff-02419c41dfa9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:47:57.040Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c3a64c75-3832-4aa8-8bff-02419c41dfa9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:47:57.041Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c3a64c75-3832-4aa8-8bff-02419c41dfa9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:47:57.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=658a2cab-e4a0-4d66-abe9-c5df80c07007 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:47:57.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=658a2cab-e4a0-4d66-abe9-c5df80c07007 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b21974a 2021-04-14T11:47:57.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=658a2cab-e4a0-4d66-abe9-c5df80c07007 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:47:57.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=658a2cab-e4a0-4d66-abe9-c5df80c07007 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:47:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:00.797Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=658a2cab-e4a0-4d66-abe9-c5df80c07007 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:48:00.798Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=658a2cab-e4a0-4d66-abe9-c5df80c07007 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:48:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:00.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34678305-0f80-4373-903f-2b73856a0d4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:00.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34678305-0f80-4373-903f-2b73856a0d4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35c1f4ef 2021-04-14T11:48:00.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34678305-0f80-4373-903f-2b73856a0d4f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:00.973Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34678305-0f80-4373-903f-2b73856a0d4f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:03.983Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=34678305-0f80-4373-903f-2b73856a0d4f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:48:03.983Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=34678305-0f80-4373-903f-2b73856a0d4f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:48:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:48:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:48:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:48:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:48:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:48:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:48:04.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=329a951b-1da1-4794-b117-0a7cff623f76 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:04.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=329a951b-1da1-4794-b117-0a7cff623f76 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@140534f0 2021-04-14T11:48:04.718Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=329a951b-1da1-4794-b117-0a7cff623f76 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:04.719Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=329a951b-1da1-4794-b117-0a7cff623f76 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:06.248Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0ac8d6a9-40f9-4514-a954-ea341b9afc34 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:48:06.247853Z InvocationID=05243a8e-8d11-4c56-8411-f06d1d4d5a1a LogTimestamp=2021-04-14T11:48:06.247909Z Entering 2021-04-14T11:48:06.248Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0ac8d6a9-40f9-4514-a954-ea341b9afc34 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:48:06.247853Z InvocationID=05243a8e-8d11-4c56-8411-f06d1d4d5a1a LogTimestamp=2021-04-14T11:48:06.247909Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:48:06.248Z [qtp580718781-17] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:48:06.248Z InvocationID=a957fbec-e39d-4fee-8bff-19c049140ba4 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:48:06.249Z [qtp580718781-17] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=0 EndTimestamp=2021-04-14T11:48:06.248Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:48:06.248Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=a957fbec-e39d-4fee-8bff-19c049140ba4 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@883d403 2021-04-14T11:48:06.249Z [qtp580718781-17] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=0 EndTimestamp=2021-04-14T11:48:06.248Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:48:06.248Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=a957fbec-e39d-4fee-8bff-19c049140ba4 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@883d403 2021-04-14T11:48:06.249Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:48:06.249267Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:48:06.249Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:48:06.249267Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:48:06.249Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:48:06.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:07.729Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=329a951b-1da1-4794-b117-0a7cff623f76 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:48:07.730Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=329a951b-1da1-4794-b117-0a7cff623f76 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:48:08.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dfb5e5-87bd-4cdb-bcb8-e45f994df6de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:08.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dfb5e5-87bd-4cdb-bcb8-e45f994df6de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71981622 2021-04-14T11:48:08.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dfb5e5-87bd-4cdb-bcb8-e45f994df6de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:08.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8dfb5e5-87bd-4cdb-bcb8-e45f994df6de PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:09.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:11.290Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a8dfb5e5-87bd-4cdb-bcb8-e45f994df6de ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:48:11.290Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a8dfb5e5-87bd-4cdb-bcb8-e45f994df6de ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:48:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=514ec210-1e96-48d1-b26e-4cce4cf49a71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=514ec210-1e96-48d1-b26e-4cce4cf49a71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34b66844 2021-04-14T11:48:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=514ec210-1e96-48d1-b26e-4cce4cf49a71 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=514ec210-1e96-48d1-b26e-4cce4cf49a71 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:15.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ac2d078-cd86-4677-929e-3346bf67ed39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:15.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ac2d078-cd86-4677-929e-3346bf67ed39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69af9a74 2021-04-14T11:48:15.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ac2d078-cd86-4677-929e-3346bf67ed39 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:15.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ac2d078-cd86-4677-929e-3346bf67ed39 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:16.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=befe0cd2-55c7-4a54-8bee-efdb07a7e68a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:16.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=befe0cd2-55c7-4a54-8bee-efdb07a7e68a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bbd00a3 2021-04-14T11:48:16.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=befe0cd2-55c7-4a54-8bee-efdb07a7e68a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:16.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=befe0cd2-55c7-4a54-8bee-efdb07a7e68a PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a332cc44-a64d-4d41-be50-3f4acdf77e46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a332cc44-a64d-4d41-be50-3f4acdf77e46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c4ea9d8 2021-04-14T11:48:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a332cc44-a64d-4d41-be50-3f4acdf77e46 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:17.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a332cc44-a64d-4d41-be50-3f4acdf77e46 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8068f298-3d42-417e-95a3-3e186caa509e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8068f298-3d42-417e-95a3-3e186caa509e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@496e7709 2021-04-14T11:48:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8068f298-3d42-417e-95a3-3e186caa509e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:18.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8068f298-3d42-417e-95a3-3e186caa509e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:19.308Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60d23400-25d3-4095-96b5-d1d372eee20c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:19.308Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60d23400-25d3-4095-96b5-d1d372eee20c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c87386a 2021-04-14T11:48:19.309Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60d23400-25d3-4095-96b5-d1d372eee20c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:19.309Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60d23400-25d3-4095-96b5-d1d372eee20c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:19.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07df7f1e-02a9-4bf1-9fc9-045069eac007 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:19.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07df7f1e-02a9-4bf1-9fc9-045069eac007 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f7c8341 2021-04-14T11:48:19.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07df7f1e-02a9-4bf1-9fc9-045069eac007 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:19.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07df7f1e-02a9-4bf1-9fc9-045069eac007 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:20.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f662266-86e1-4871-8c61-a9ea6dd0197c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:20.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f662266-86e1-4871-8c61-a9ea6dd0197c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46a5f91f 2021-04-14T11:48:20.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f662266-86e1-4871-8c61-a9ea6dd0197c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:20.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f662266-86e1-4871-8c61-a9ea6dd0197c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee6aa39-1ff8-4f69-a50c-25ec7ec3004f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee6aa39-1ff8-4f69-a50c-25ec7ec3004f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c4918fd 2021-04-14T11:48:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee6aa39-1ff8-4f69-a50c-25ec7ec3004f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:20.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee6aa39-1ff8-4f69-a50c-25ec7ec3004f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:20.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e05263-81f8-434d-ac30-dd098fd6f592 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:20.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e05263-81f8-434d-ac30-dd098fd6f592 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19e83b76 2021-04-14T11:48:20.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e05263-81f8-434d-ac30-dd098fd6f592 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:20.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e05263-81f8-434d-ac30-dd098fd6f592 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:21.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c59eb755-60c9-4b4d-b8c4-41d7650fb673 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:21.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c59eb755-60c9-4b4d-b8c4-41d7650fb673 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62f5c581 2021-04-14T11:48:21.277Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c59eb755-60c9-4b4d-b8c4-41d7650fb673 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:21.278Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c59eb755-60c9-4b4d-b8c4-41d7650fb673 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:21.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d93ca68a-b8bf-4731-9548-eb0e7c4f80bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:21.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d93ca68a-b8bf-4731-9548-eb0e7c4f80bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bf1b5c1 2021-04-14T11:48:21.579Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d93ca68a-b8bf-4731-9548-eb0e7c4f80bd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:21.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d93ca68a-b8bf-4731-9548-eb0e7c4f80bd PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:22.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=634f6c22-b5d6-41a5-b95c-54265c1b5b88 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:22.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=634f6c22-b5d6-41a5-b95c-54265c1b5b88 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f4bdab2 2021-04-14T11:48:22.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=634f6c22-b5d6-41a5-b95c-54265c1b5b88 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:22.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=634f6c22-b5d6-41a5-b95c-54265c1b5b88 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edb19714-41ce-4f5c-bba5-512bfba713a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edb19714-41ce-4f5c-bba5-512bfba713a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67a075a6 2021-04-14T11:48:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edb19714-41ce-4f5c-bba5-512bfba713a8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edb19714-41ce-4f5c-bba5-512bfba713a8 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:24.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d95843-7975-4153-9542-2c4cac6201ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:24.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d95843-7975-4153-9542-2c4cac6201ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b356d1e 2021-04-14T11:48:24.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d95843-7975-4153-9542-2c4cac6201ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:24.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d95843-7975-4153-9542-2c4cac6201ee PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:25.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c856a2f-0c6b-4b4d-9e17-6f61eee21213 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:25.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c856a2f-0c6b-4b4d-9e17-6f61eee21213 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d6c8a04 2021-04-14T11:48:25.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c856a2f-0c6b-4b4d-9e17-6f61eee21213 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:25.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c856a2f-0c6b-4b4d-9e17-6f61eee21213 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:26.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb753f1-4ddd-462b-8b9d-c859026617a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:26.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb753f1-4ddd-462b-8b9d-c859026617a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c135b51 2021-04-14T11:48:26.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb753f1-4ddd-462b-8b9d-c859026617a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:26.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cb753f1-4ddd-462b-8b9d-c859026617a4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:27.066Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-04-14T11:48:12.914717Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) ... 8 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) ... 9 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:48:27.136Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:48:27.137Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 32000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:48:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e93f2a-28f0-47c0-bacb-69dd5359013f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e93f2a-28f0-47c0-bacb-69dd5359013f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@287a0a30 2021-04-14T11:48:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e93f2a-28f0-47c0-bacb-69dd5359013f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:28.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97e93f2a-28f0-47c0-bacb-69dd5359013f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:29.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fca09b-4469-4cd5-8c55-fc71b0655709 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:29.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fca09b-4469-4cd5-8c55-fc71b0655709 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28a7dfbc 2021-04-14T11:48:29.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fca09b-4469-4cd5-8c55-fc71b0655709 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:29.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04fca09b-4469-4cd5-8c55-fc71b0655709 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:30.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d0fdacc-844f-41b6-bc82-1eb58939a0a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:30.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d0fdacc-844f-41b6-bc82-1eb58939a0a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61d24c06 2021-04-14T11:48:30.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d0fdacc-844f-41b6-bc82-1eb58939a0a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:30.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d0fdacc-844f-41b6-bc82-1eb58939a0a4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:31.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:31.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:31.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036021ba-5c4d-4a11-ac0d-c2df991350ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:31.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036021ba-5c4d-4a11-ac0d-c2df991350ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@374d5abe 2021-04-14T11:48:31.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036021ba-5c4d-4a11-ac0d-c2df991350ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:31.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=036021ba-5c4d-4a11-ac0d-c2df991350ac PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:32.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ae90c6-7b97-470e-8270-2d05d22f64c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:32.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ae90c6-7b97-470e-8270-2d05d22f64c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f1efded 2021-04-14T11:48:32.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ae90c6-7b97-470e-8270-2d05d22f64c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:32.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37ae90c6-7b97-470e-8270-2d05d22f64c9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:33.261Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396) at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51) at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512) at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190) at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194) at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68) at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54) at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44) at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66) at com.google.common.collect.Iterables$4.iterator(Iterables.java:559) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:84) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:48:33.261Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation ErrorCategory=INFO RequestID=null ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1670) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:832) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:48:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:33.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7b655f6-ea54-41a0-9d64-0a8599113570 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:33.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7b655f6-ea54-41a0-9d64-0a8599113570 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5952918d 2021-04-14T11:48:33.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7b655f6-ea54-41a0-9d64-0a8599113570 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:33.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7b655f6-ea54-41a0-9d64-0a8599113570 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8f36ed8-4814-46d7-80b1-d6c297743df0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8f36ed8-4814-46d7-80b1-d6c297743df0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a1354dd 2021-04-14T11:48:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8f36ed8-4814-46d7-80b1-d6c297743df0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:35.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8f36ed8-4814-46d7-80b1-d6c297743df0 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04c08295-7fcd-45be-b671-c98a629dcbf4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04c08295-7fcd-45be-b671-c98a629dcbf4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77d6738b 2021-04-14T11:48:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04c08295-7fcd-45be-b671-c98a629dcbf4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04c08295-7fcd-45be-b671-c98a629dcbf4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:36.241Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=88f5472a-6cdb-4a39-81d7-e61b90b87d99 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:48:36.240554Z InvocationID=d5f8b9a3-762e-4880-bdbe-4e7e46d9a114 LogTimestamp=2021-04-14T11:48:36.240646Z Entering 2021-04-14T11:48:36.241Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=88f5472a-6cdb-4a39-81d7-e61b90b87d99 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:48:36.240554Z InvocationID=d5f8b9a3-762e-4880-bdbe-4e7e46d9a114 LogTimestamp=2021-04-14T11:48:36.240646Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:48:36.242Z [qtp580718781-17] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:48:36.241Z InvocationID=f55e0c98-e1c6-47f0-9bf7-626c4f47efa0 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:48:36.242Z [qtp580718781-17] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:48:36.242Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:48:36.241Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=f55e0c98-e1c6-47f0-9bf7-626c4f47efa0 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@3dbc77c3 2021-04-14T11:48:36.242Z [qtp580718781-17] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:48:36.242Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:48:36.241Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=f55e0c98-e1c6-47f0-9bf7-626c4f47efa0 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@3dbc77c3 2021-04-14T11:48:36.243Z [qtp580718781-17] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:48:36.243110Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:48:36.243Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:48:36.243110Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:48:36.243Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:48:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:37.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e29f59ca-3299-4e55-8978-aabdc9e04ec0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:37.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e29f59ca-3299-4e55-8978-aabdc9e04ec0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f9f0909 2021-04-14T11:48:37.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e29f59ca-3299-4e55-8978-aabdc9e04ec0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:37.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e29f59ca-3299-4e55-8978-aabdc9e04ec0 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:37.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4eccd5c-f940-4ef2-80c4-e3f171ebb0d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:37.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4eccd5c-f940-4ef2-80c4-e3f171ebb0d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c278e 2021-04-14T11:48:37.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4eccd5c-f940-4ef2-80c4-e3f171ebb0d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:37.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4eccd5c-f940-4ef2-80c4-e3f171ebb0d9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:38.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddd2d5f1-0e94-48da-abad-259f247b2371 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:38.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddd2d5f1-0e94-48da-abad-259f247b2371 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32093ebe 2021-04-14T11:48:38.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddd2d5f1-0e94-48da-abad-259f247b2371 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:38.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddd2d5f1-0e94-48da-abad-259f247b2371 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:39.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34e9ec7-b976-4570-9fbc-e08fc7dc2774 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:39.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34e9ec7-b976-4570-9fbc-e08fc7dc2774 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7607495f 2021-04-14T11:48:39.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34e9ec7-b976-4570-9fbc-e08fc7dc2774 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:39.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e34e9ec7-b976-4570-9fbc-e08fc7dc2774 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:39.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:39.833Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-04-14T11:48:12.914717Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) ... 8 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) ... 9 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:48:39.834Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation ErrorCategory=INFO RequestID=null ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=500 TargetEntity=ReplaceDataTypesCache Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1670) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:832) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:48:39.836Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:48:40.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41bb9b7-fe86-4b90-b83f-d4e1557db4d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:40.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41bb9b7-fe86-4b90-b83f-d4e1557db4d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4167c1d7 2021-04-14T11:48:40.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41bb9b7-fe86-4b90-b83f-d4e1557db4d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:40.360Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d41bb9b7-fe86-4b90-b83f-d4e1557db4d9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:40.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bbf750b-7963-4cd3-a233-ecc7e9edb41f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:40.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bbf750b-7963-4cd3-a233-ecc7e9edb41f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22342e22 2021-04-14T11:48:40.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bbf750b-7963-4cd3-a233-ecc7e9edb41f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:40.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bbf750b-7963-4cd3-a233-ecc7e9edb41f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:40.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2062fc-d126-472d-91b0-409e7ea6183d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:40.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2062fc-d126-472d-91b0-409e7ea6183d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59330814 2021-04-14T11:48:40.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2062fc-d126-472d-91b0-409e7ea6183d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:40.758Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa2062fc-d126-472d-91b0-409e7ea6183d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:41.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0965a9d5-97e6-4fc7-905a-f060a2e621d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:41.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0965a9d5-97e6-4fc7-905a-f060a2e621d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15b2ffdc 2021-04-14T11:48:41.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0965a9d5-97e6-4fc7-905a-f060a2e621d6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:41.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0965a9d5-97e6-4fc7-905a-f060a2e621d6 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:41.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca5b97ad-8663-4aad-973c-2efa9729182b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:41.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca5b97ad-8663-4aad-973c-2efa9729182b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6aa4fdc4 2021-04-14T11:48:41.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca5b97ad-8663-4aad-973c-2efa9729182b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:41.290Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca5b97ad-8663-4aad-973c-2efa9729182b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:41.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea36e72a-885b-4a4b-8264-6f0703d17601 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:41.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea36e72a-885b-4a4b-8264-6f0703d17601 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69e29b8c 2021-04-14T11:48:41.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea36e72a-885b-4a4b-8264-6f0703d17601 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:41.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea36e72a-885b-4a4b-8264-6f0703d17601 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:41.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9acede55-5050-4375-bef4-7e3d9d00da88 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:41.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9acede55-5050-4375-bef4-7e3d9d00da88 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28505d0c 2021-04-14T11:48:41.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9acede55-5050-4375-bef4-7e3d9d00da88 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:41.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9acede55-5050-4375-bef4-7e3d9d00da88 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:42.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2518078-87d2-4440-833b-65a92ca8f5f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:42.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2518078-87d2-4440-833b-65a92ca8f5f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a1e0bc5 2021-04-14T11:48:42.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2518078-87d2-4440-833b-65a92ca8f5f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:42.245Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2518078-87d2-4440-833b-65a92ca8f5f9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033c84b7-ba76-4583-aa39-23918c688105 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033c84b7-ba76-4583-aa39-23918c688105 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6799999f 2021-04-14T11:48:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033c84b7-ba76-4583-aa39-23918c688105 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:42.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=033c84b7-ba76-4583-aa39-23918c688105 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:43.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0215d4ef-fc97-4b03-b385-4195f9b498d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:43.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0215d4ef-fc97-4b03-b385-4195f9b498d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a5a401b 2021-04-14T11:48:43.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0215d4ef-fc97-4b03-b385-4195f9b498d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:43.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0215d4ef-fc97-4b03-b385-4195f9b498d4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b330efa1-4148-4b23-b79f-0fbca398eed7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b330efa1-4148-4b23-b79f-0fbca398eed7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3048c661 2021-04-14T11:48:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b330efa1-4148-4b23-b79f-0fbca398eed7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:45.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b330efa1-4148-4b23-b79f-0fbca398eed7 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:48:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:48:48.225Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b330efa1-4148-4b23-b79f-0fbca398eed7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:48:48.225Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b330efa1-4148-4b23-b79f-0fbca398eed7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:48:48.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1c7b5c-3ed0-4d46-b6b7-8b23775b3c30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:48.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1c7b5c-3ed0-4d46-b6b7-8b23775b3c30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ad2b38e 2021-04-14T11:48:48.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1c7b5c-3ed0-4d46-b6b7-8b23775b3c30 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:48.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f1c7b5c-3ed0-4d46-b6b7-8b23775b3c30 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:50.583Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Internal Connection problem. Description: Failed to fetch data types from graph(cache) 2021-04-14T11:48:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:51.812Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9f1c7b5c-3ed0-4d46-b6b7-8b23775b3c30 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:48:51.813Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9f1c7b5c-3ed0-4d46-b6b7-8b23775b3c30 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:48:52.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5913192-f283-44d2-917c-d52c58ae8e43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:52.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5913192-f283-44d2-917c-d52c58ae8e43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@93e409c 2021-04-14T11:48:52.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5913192-f283-44d2-917c-d52c58ae8e43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:52.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5913192-f283-44d2-917c-d52c58ae8e43 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:53.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4903d918-d97b-43a4-aaae-70194e22b351 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:53.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4903d918-d97b-43a4-aaae-70194e22b351 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@266af 2021-04-14T11:48:53.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4903d918-d97b-43a4-aaae-70194e22b351 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:53.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4903d918-d97b-43a4-aaae-70194e22b351 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:54.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a510497c-bb4f-48ce-a5b6-16197a347e1b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:54.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a510497c-bb4f-48ce-a5b6-16197a347e1b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25da515f 2021-04-14T11:48:54.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a510497c-bb4f-48ce-a5b6-16197a347e1b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:54.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a510497c-bb4f-48ce-a5b6-16197a347e1b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:54.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=431b209d-d91a-478c-ac3c-11fd4de84e40 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:54.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=431b209d-d91a-478c-ac3c-11fd4de84e40 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e9bdfd8 2021-04-14T11:48:54.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=431b209d-d91a-478c-ac3c-11fd4de84e40 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:54.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=431b209d-d91a-478c-ac3c-11fd4de84e40 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:54.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3b15b5-947b-4490-a46e-2fdf997b47e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:54.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3b15b5-947b-4490-a46e-2fdf997b47e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ee8135b 2021-04-14T11:48:54.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3b15b5-947b-4490-a46e-2fdf997b47e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:54.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f3b15b5-947b-4490-a46e-2fdf997b47e4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:55.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13466683-f09d-470b-978c-d441368eff87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:55.291Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13466683-f09d-470b-978c-d441368eff87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d4c3d37 2021-04-14T11:48:55.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13466683-f09d-470b-978c-d441368eff87 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:55.292Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13466683-f09d-470b-978c-d441368eff87 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:56.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b1909d-c6ac-4fbe-ae1b-7f85bd2e21ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:56.487Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b1909d-c6ac-4fbe-ae1b-7f85bd2e21ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a6bd168 2021-04-14T11:48:56.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b1909d-c6ac-4fbe-ae1b-7f85bd2e21ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:56.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b1909d-c6ac-4fbe-ae1b-7f85bd2e21ce PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:57.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326e6e2-83ea-49eb-b64b-77319b658f12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:57.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326e6e2-83ea-49eb-b64b-77319b658f12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a0eb0e2 2021-04-14T11:48:57.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326e6e2-83ea-49eb-b64b-77319b658f12 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:57.399Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1326e6e2-83ea-49eb-b64b-77319b658f12 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:48:58.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a4ae0f-f7bd-4a8c-bb9f-3c2744f8e4a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:58.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a4ae0f-f7bd-4a8c-bb9f-3c2744f8e4a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24021233 2021-04-14T11:48:58.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a4ae0f-f7bd-4a8c-bb9f-3c2744f8e4a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:58.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a4ae0f-f7bd-4a8c-bb9f-3c2744f8e4a1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:59.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf4472a-0e1a-4417-99ed-3daa7fdfb3ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:59.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf4472a-0e1a-4417-99ed-3daa7fdfb3ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@686b2601 2021-04-14T11:48:59.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf4472a-0e1a-4417-99ed-3daa7fdfb3ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:59.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdf4472a-0e1a-4417-99ed-3daa7fdfb3ad PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:59.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=578c60e1-6b20-4586-8257-609173724621 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:59.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=578c60e1-6b20-4586-8257-609173724621 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c0f5af5 2021-04-14T11:48:59.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=578c60e1-6b20-4586-8257-609173724621 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:59.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=578c60e1-6b20-4586-8257-609173724621 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:48:59.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432a0ca5-4db9-4ec6-9b09-389518d4d7df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:48:59.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432a0ca5-4db9-4ec6-9b09-389518d4d7df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43296e36 2021-04-14T11:48:59.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432a0ca5-4db9-4ec6-9b09-389518d4d7df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:48:59.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=432a0ca5-4db9-4ec6-9b09-389518d4d7df PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:00.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00c45f3c-bd6b-4704-bde4-7d328619c06d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:00.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00c45f3c-bd6b-4704-bde4-7d328619c06d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@770e7fea 2021-04-14T11:49:00.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00c45f3c-bd6b-4704-bde4-7d328619c06d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:00.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00c45f3c-bd6b-4704-bde4-7d328619c06d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:00.262Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a35ab4-4f53-4692-853f-1865d297aff1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:00.262Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a35ab4-4f53-4692-853f-1865d297aff1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46641424 2021-04-14T11:49:00.262Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a35ab4-4f53-4692-853f-1865d297aff1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:00.262Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86a35ab4-4f53-4692-853f-1865d297aff1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:00.511Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bbc527-220b-4cfd-b13d-224bda4ce1b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:00.511Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bbc527-220b-4cfd-b13d-224bda4ce1b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@502a26ef 2021-04-14T11:49:00.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bbc527-220b-4cfd-b13d-224bda4ce1b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:00.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bbc527-220b-4cfd-b13d-224bda4ce1b1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:00.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:00.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20738913-ad53-4fa9-a2e4-100e9e5b676e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:00.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20738913-ad53-4fa9-a2e4-100e9e5b676e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@587aaa02 2021-04-14T11:49:00.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20738913-ad53-4fa9-a2e4-100e9e5b676e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:00.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20738913-ad53-4fa9-a2e4-100e9e5b676e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:01.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a37a1de-574a-4970-abb8-899c2d23bcde PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:01.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a37a1de-574a-4970-abb8-899c2d23bcde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c0f7fc8 2021-04-14T11:49:01.148Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a37a1de-574a-4970-abb8-899c2d23bcde PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:01.149Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a37a1de-574a-4970-abb8-899c2d23bcde PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:01.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=144f717e-3dd8-499b-b365-a1cc20e368af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:01.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=144f717e-3dd8-499b-b365-a1cc20e368af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a2c9559 2021-04-14T11:49:01.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=144f717e-3dd8-499b-b365-a1cc20e368af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:01.348Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=144f717e-3dd8-499b-b365-a1cc20e368af PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:49:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:49:04.351Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=144f717e-3dd8-499b-b365-a1cc20e368af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:04.351Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=144f717e-3dd8-499b-b365-a1cc20e368af ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:49:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:49:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:49:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:49:05.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04dda7e7-7a68-4ac1-8ce1-55b27b9d1a9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:05.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04dda7e7-7a68-4ac1-8ce1-55b27b9d1a9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b30d1ad 2021-04-14T11:49:05.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04dda7e7-7a68-4ac1-8ce1-55b27b9d1a9c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:05.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04dda7e7-7a68-4ac1-8ce1-55b27b9d1a9c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:06.263Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c2bd8637-1505-474a-8935-870eacc35c26 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:49:06.262523Z InvocationID=5d66b56f-2156-4db4-b6cf-11deaff2c4e6 LogTimestamp=2021-04-14T11:49:06.262632Z Entering 2021-04-14T11:49:06.263Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c2bd8637-1505-474a-8935-870eacc35c26 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:49:06.262523Z InvocationID=5d66b56f-2156-4db4-b6cf-11deaff2c4e6 LogTimestamp=2021-04-14T11:49:06.262632Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:49:06.264Z [qtp580718781-14] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:49:06.263Z InvocationID=c277fdd2-29c9-4063-94f9-f0fde48a91c8 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:49:06.265Z [qtp580718781-14] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:49:06.264Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:49:06.263Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=c277fdd2-29c9-4063-94f9-f0fde48a91c8 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@3929170c 2021-04-14T11:49:06.265Z [qtp580718781-14] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:49:06.264Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:49:06.263Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=c277fdd2-29c9-4063-94f9-f0fde48a91c8 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@3929170c 2021-04-14T11:49:06.265Z [qtp580718781-14] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:49:06.265356Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:49:06.265Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:49:06.265356Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:49:06.265Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:49:06.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:08.224Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=04dda7e7-7a68-4ac1-8ce1-55b27b9d1a9c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:49:08.224Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=04dda7e7-7a68-4ac1-8ce1-55b27b9d1a9c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:49:08.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10c43abb-8dfb-4538-b558-064a0ef7d6de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:08.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10c43abb-8dfb-4538-b558-064a0ef7d6de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11c19e56 2021-04-14T11:49:08.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10c43abb-8dfb-4538-b558-064a0ef7d6de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:08.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10c43abb-8dfb-4538-b558-064a0ef7d6de PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:09.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:11.810Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=10c43abb-8dfb-4538-b558-064a0ef7d6de ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:49:11.810Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=10c43abb-8dfb-4538-b558-064a0ef7d6de ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:49:12.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf9f287b-bf56-402d-9eb8-6077404a3d01 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:12.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf9f287b-bf56-402d-9eb8-6077404a3d01 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72194a9d 2021-04-14T11:49:12.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf9f287b-bf56-402d-9eb8-6077404a3d01 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:12.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf9f287b-bf56-402d-9eb8-6077404a3d01 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:15.636Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cf9f287b-bf56-402d-9eb8-6077404a3d01 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:49:15.637Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cf9f287b-bf56-402d-9eb8-6077404a3d01 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:49:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:16.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:16.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e24308a3-331b-4d27-91f3-38ad4fe35756 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:16.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e24308a3-331b-4d27-91f3-38ad4fe35756 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@639f2cdd 2021-04-14T11:49:16.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e24308a3-331b-4d27-91f3-38ad4fe35756 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:16.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e24308a3-331b-4d27-91f3-38ad4fe35756 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:21.919Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e24308a3-331b-4d27-91f3-38ad4fe35756 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:21.919Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e24308a3-331b-4d27-91f3-38ad4fe35756 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:22.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f50e448a-bbb3-4b18-bc50-805c635084aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:22.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f50e448a-bbb3-4b18-bc50-805c635084aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e4de62b 2021-04-14T11:49:22.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f50e448a-bbb3-4b18-bc50-805c635084aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:22.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f50e448a-bbb3-4b18-bc50-805c635084aa PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:25.124Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f50e448a-bbb3-4b18-bc50-805c635084aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:49:25.125Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f50e448a-bbb3-4b18-bc50-805c635084aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:49:25.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e07007f-f4c1-4e8d-bff2-a9c3d1605d70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:25.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e07007f-f4c1-4e8d-bff2-a9c3d1605d70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@331ba101 2021-04-14T11:49:25.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e07007f-f4c1-4e8d-bff2-a9c3d1605d70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:25.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e07007f-f4c1-4e8d-bff2-a9c3d1605d70 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:27.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:30.307Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9e07007f-f4c1-4e8d-bff2-a9c3d1605d70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:30.307Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9e07007f-f4c1-4e8d-bff2-a9c3d1605d70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:31.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62171f55-74b8-489d-9c82-22d57fd6cbc3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:31.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62171f55-74b8-489d-9c82-22d57fd6cbc3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24e6fc0c 2021-04-14T11:49:31.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62171f55-74b8-489d-9c82-22d57fd6cbc3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:31.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62171f55-74b8-489d-9c82-22d57fd6cbc3 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:32.630Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-04-14T11:49:06.501210Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) ... 8 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) ... 9 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:49:32.633Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:49:32.634Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 64000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:49:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:34.133Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=62171f55-74b8-489d-9c82-22d57fd6cbc3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:49:34.133Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=62171f55-74b8-489d-9c82-22d57fd6cbc3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:49:34.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ee459d-594e-4f82-b473-b2ea041e6aa9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:34.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ee459d-594e-4f82-b473-b2ea041e6aa9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27c7cb99 2021-04-14T11:49:34.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ee459d-594e-4f82-b473-b2ea041e6aa9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:34.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ee459d-594e-4f82-b473-b2ea041e6aa9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:36.244Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b25de2cd-7f96-47be-b218-0378ca02dbe4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:49:36.244127Z InvocationID=af0425b6-b794-47a7-86d9-a1e6b83b5375 LogTimestamp=2021-04-14T11:49:36.244284Z Entering 2021-04-14T11:49:36.245Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b25de2cd-7f96-47be-b218-0378ca02dbe4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:49:36.244127Z InvocationID=af0425b6-b794-47a7-86d9-a1e6b83b5375 LogTimestamp=2021-04-14T11:49:36.244284Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:49:36.246Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:49:36.245Z InvocationID=14d40a26-f856-4010-92ec-7897bc469254 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:49:36.247Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:49:36.246Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:49:36.245Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=14d40a26-f856-4010-92ec-7897bc469254 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@263ac02d 2021-04-14T11:49:36.247Z [qtp580718781-16] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:49:36.246Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:49:36.245Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=14d40a26-f856-4010-92ec-7897bc469254 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@263ac02d 2021-04-14T11:49:36.249Z [qtp580718781-16] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:49:36.248866Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:49:36.249Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:49:36.248866Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:49:36.250Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:49:36.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:38.141Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d3ee459d-594e-4f82-b473-b2ea041e6aa9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:38.142Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d3ee459d-594e-4f82-b473-b2ea041e6aa9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:38.458Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c731ad08-ec51-4479-800e-2abab7067a61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:38.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c731ad08-ec51-4479-800e-2abab7067a61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7854cee9 2021-04-14T11:49:38.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c731ad08-ec51-4479-800e-2abab7067a61 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:38.459Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c731ad08-ec51-4479-800e-2abab7067a61 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:41.803Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=c731ad08-ec51-4479-800e-2abab7067a61 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:41.803Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=c731ad08-ec51-4479-800e-2abab7067a61 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc64478-39e2-42bb-aeec-9215bff4251b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc64478-39e2-42bb-aeec-9215bff4251b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b3677e1 2021-04-14T11:49:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc64478-39e2-42bb-aeec-9215bff4251b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:41.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc64478-39e2-42bb-aeec-9215bff4251b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:49:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:49:47.162Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ddc64478-39e2-42bb-aeec-9215bff4251b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:47.163Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ddc64478-39e2-42bb-aeec-9215bff4251b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:47.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfcc0a96-27cf-43a7-a920-78bbf355f711 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:47.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfcc0a96-27cf-43a7-a920-78bbf355f711 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@442386f3 2021-04-14T11:49:47.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfcc0a96-27cf-43a7-a920-78bbf355f711 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:47.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfcc0a96-27cf-43a7-a920-78bbf355f711 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:48.211Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1e878275-1699-4c40-ab7f-36cac3b93b60 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:49:48.211603Z InvocationID=f76e7471-7021-4647-af83-af19c19e00fe LogTimestamp=2021-04-14T11:49:48.211657Z Entering 2021-04-14T11:49:48.212Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1e878275-1699-4c40-ab7f-36cac3b93b60 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:49:48.211603Z InvocationID=f76e7471-7021-4647-af83-af19c19e00fe LogTimestamp=2021-04-14T11:49:48.211657Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:49:48.212Z [qtp580718781-13] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:49:48.212Z InvocationID=b687b45d-1ef8-4b66-8cc8-e316d7655a9d ErrorCode=500 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:49:48.213Z [qtp580718781-13] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=clamp ElapsedTime=0 EndTimestamp=2021-04-14T11:49:48.212Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.228.190 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:49:48.212Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b687b45d-1ef8-4b66-8cc8-e316d7655a9d ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@4738942e 2021-04-14T11:49:48.213Z [qtp580718781-13] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=clamp ElapsedTime=0 EndTimestamp=2021-04-14T11:49:48.212Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.228.190 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:49:48.212Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b687b45d-1ef8-4b66-8cc8-e316d7655a9d ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@4738942e 2021-04-14T11:49:48.213Z [qtp580718781-13] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:49:48.213492Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:49:48.213Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:49:48.213492Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:49:48.213Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:49:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:52.093Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bfcc0a96-27cf-43a7-a920-78bbf355f711 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:49:52.094Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bfcc0a96-27cf-43a7-a920-78bbf355f711 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:49:53.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00ca8c0f-722b-460d-89c2-c14dfe7186b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:53.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00ca8c0f-722b-460d-89c2-c14dfe7186b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@490a4ee6 2021-04-14T11:49:53.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00ca8c0f-722b-460d-89c2-c14dfe7186b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:53.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00ca8c0f-722b-460d-89c2-c14dfe7186b9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:54.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3628f40-8d66-48ec-9c04-db3492ed483c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:54.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3628f40-8d66-48ec-9c04-db3492ed483c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a751922 2021-04-14T11:49:54.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3628f40-8d66-48ec-9c04-db3492ed483c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:54.497Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3628f40-8d66-48ec-9c04-db3492ed483c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:54.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e05498-12f5-45eb-b979-891d40d8432c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:54.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e05498-12f5-45eb-b979-891d40d8432c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2620bf9d 2021-04-14T11:49:54.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e05498-12f5-45eb-b979-891d40d8432c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:54.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e05498-12f5-45eb-b979-891d40d8432c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:56.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde80ec3-ad50-4559-a7cd-2d2cbb6a4333 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:56.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde80ec3-ad50-4559-a7cd-2d2cbb6a4333 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d46a8c1 2021-04-14T11:49:56.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde80ec3-ad50-4559-a7cd-2d2cbb6a4333 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:56.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bde80ec3-ad50-4559-a7cd-2d2cbb6a4333 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:57.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450ab52b-9a02-4957-8338-64f7094c1405 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:57.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450ab52b-9a02-4957-8338-64f7094c1405 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57a96d26 2021-04-14T11:49:57.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450ab52b-9a02-4957-8338-64f7094c1405 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:57.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450ab52b-9a02-4957-8338-64f7094c1405 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:49:58.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb1c991-e09c-45c4-b645-a03986d1343b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:58.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb1c991-e09c-45c4-b645-a03986d1343b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@547d2f8 2021-04-14T11:49:58.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb1c991-e09c-45c4-b645-a03986d1343b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:58.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb1c991-e09c-45c4-b645-a03986d1343b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:59.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064d6432-91cb-469e-bf19-2c993699608f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:59.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064d6432-91cb-469e-bf19-2c993699608f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2638599a 2021-04-14T11:49:59.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064d6432-91cb-469e-bf19-2c993699608f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:59.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=064d6432-91cb-469e-bf19-2c993699608f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:59.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd31ff1b-ec83-4245-91d4-4702b8fda8c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:59.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd31ff1b-ec83-4245-91d4-4702b8fda8c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2eb0ed3c 2021-04-14T11:49:59.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd31ff1b-ec83-4245-91d4-4702b8fda8c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:59.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd31ff1b-ec83-4245-91d4-4702b8fda8c5 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:49:59.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4a1e661-4d42-4468-b70d-96bd26b320e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:49:59.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4a1e661-4d42-4468-b70d-96bd26b320e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@326c7591 2021-04-14T11:49:59.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4a1e661-4d42-4468-b70d-96bd26b320e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:49:59.978Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4a1e661-4d42-4468-b70d-96bd26b320e9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:00.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96685426-3d1a-4e83-bef7-8d7b5cacfaa8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:00.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96685426-3d1a-4e83-bef7-8d7b5cacfaa8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@987b136 2021-04-14T11:50:00.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96685426-3d1a-4e83-bef7-8d7b5cacfaa8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:00.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96685426-3d1a-4e83-bef7-8d7b5cacfaa8 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:00.493Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46e34279-daff-462c-b5ac-10a50264f0f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:00.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46e34279-daff-462c-b5ac-10a50264f0f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d17cd15 2021-04-14T11:50:00.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46e34279-daff-462c-b5ac-10a50264f0f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:00.494Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46e34279-daff-462c-b5ac-10a50264f0f3 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:00.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450cce14-68cc-4516-9402-b704d6cc3c6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:00.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450cce14-68cc-4516-9402-b704d6cc3c6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44671486 2021-04-14T11:50:00.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450cce14-68cc-4516-9402-b704d6cc3c6d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:00.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=450cce14-68cc-4516-9402-b704d6cc3c6d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:00.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:00.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=686f5d55-d53f-43fa-b213-fb037a258f73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:00.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=686f5d55-d53f-43fa-b213-fb037a258f73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15f63166 2021-04-14T11:50:00.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=686f5d55-d53f-43fa-b213-fb037a258f73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:00.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=686f5d55-d53f-43fa-b213-fb037a258f73 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:01.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0db15fd-2452-45fb-ac62-ee6b12f23244 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:01.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0db15fd-2452-45fb-ac62-ee6b12f23244 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21cc2cef 2021-04-14T11:50:01.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0db15fd-2452-45fb-ac62-ee6b12f23244 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:01.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0db15fd-2452-45fb-ac62-ee6b12f23244 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:01.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b42824d8-b1ef-48a1-9a5c-ee5f03134511 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:01.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b42824d8-b1ef-48a1-9a5c-ee5f03134511 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@726022a6 2021-04-14T11:50:01.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b42824d8-b1ef-48a1-9a5c-ee5f03134511 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:01.450Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b42824d8-b1ef-48a1-9a5c-ee5f03134511 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:01.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9692792-a5ce-4f8e-a413-a37f2f1f238b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:01.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9692792-a5ce-4f8e-a413-a37f2f1f238b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e5fcb48 2021-04-14T11:50:01.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9692792-a5ce-4f8e-a413-a37f2f1f238b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:01.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9692792-a5ce-4f8e-a413-a37f2f1f238b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:02.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=545a50c9-a42e-4c63-8ca4-bb4b79eed742 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:02.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=545a50c9-a42e-4c63-8ca4-bb4b79eed742 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a06a6e4 2021-04-14T11:50:02.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=545a50c9-a42e-4c63-8ca4-bb4b79eed742 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:02.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=545a50c9-a42e-4c63-8ca4-bb4b79eed742 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:03.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0622a7e7-7f0a-4d44-b667-ab341521c943 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:03.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0622a7e7-7f0a-4d44-b667-ab341521c943 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a6d4c1f 2021-04-14T11:50:03.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0622a7e7-7f0a-4d44-b667-ab341521c943 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:03.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0622a7e7-7f0a-4d44-b667-ab341521c943 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:03.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:50:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:50:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:50:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:50:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:50:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:50:04.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e814481-0b5c-4cde-816f-98af67e36a24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:04.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e814481-0b5c-4cde-816f-98af67e36a24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@196b26e6 2021-04-14T11:50:04.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e814481-0b5c-4cde-816f-98af67e36a24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:04.514Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e814481-0b5c-4cde-816f-98af67e36a24 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:05.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e3e02c-14e8-48a4-8f0f-7a22f73045aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:05.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e3e02c-14e8-48a4-8f0f-7a22f73045aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@691eab08 2021-04-14T11:50:05.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e3e02c-14e8-48a4-8f0f-7a22f73045aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:05.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11e3e02c-14e8-48a4-8f0f-7a22f73045aa PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:06.261Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=448563b5-b44d-47d4-b0b8-25c665f381c8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:50:06.260755Z InvocationID=0fcc8143-d17a-42a0-b35e-3bcbdc3e5f61 LogTimestamp=2021-04-14T11:50:06.260842Z Entering 2021-04-14T11:50:06.261Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=448563b5-b44d-47d4-b0b8-25c665f381c8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:50:06.260755Z InvocationID=0fcc8143-d17a-42a0-b35e-3bcbdc3e5f61 LogTimestamp=2021-04-14T11:50:06.260842Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:50:06.261Z [qtp580718781-18] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:50:06.261Z InvocationID=b8686035-fe71-4fb0-aa1a-a9f38fa3d385 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:50:06.262Z [qtp580718781-18] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:50:06.262Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:50:06.261Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b8686035-fe71-4fb0-aa1a-a9f38fa3d385 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@385a5b8a 2021-04-14T11:50:06.262Z [qtp580718781-18] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:50:06.262Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:50:06.261Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b8686035-fe71-4fb0-aa1a-a9f38fa3d385 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@385a5b8a 2021-04-14T11:50:06.262Z [qtp580718781-18] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:50:06.262656Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:50:06.262Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:50:06.262656Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:50:06.263Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:50:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:08.323Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=11e3e02c-14e8-48a4-8f0f-7a22f73045aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:50:08.323Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=11e3e02c-14e8-48a4-8f0f-7a22f73045aa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:50:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40defa3d-57ad-4393-a121-c0faddc951dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40defa3d-57ad-4393-a121-c0faddc951dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76b01149 2021-04-14T11:50:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40defa3d-57ad-4393-a121-c0faddc951dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40defa3d-57ad-4393-a121-c0faddc951dd PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:09.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:12.022Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=40defa3d-57ad-4393-a121-c0faddc951dd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:12.022Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=40defa3d-57ad-4393-a121-c0faddc951dd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:12.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27aae22a-f3db-425e-9e88-3daff55b8a6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:12.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27aae22a-f3db-425e-9e88-3daff55b8a6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36a1e213 2021-04-14T11:50:12.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27aae22a-f3db-425e-9e88-3daff55b8a6d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:12.634Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27aae22a-f3db-425e-9e88-3daff55b8a6d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:12.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:15.641Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=27aae22a-f3db-425e-9e88-3daff55b8a6d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:15.641Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=27aae22a-f3db-425e-9e88-3daff55b8a6d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:16.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe836054-5862-4229-9cda-47a9f330e1ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:16.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe836054-5862-4229-9cda-47a9f330e1ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c373f7b 2021-04-14T11:50:16.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe836054-5862-4229-9cda-47a9f330e1ca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:16.402Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe836054-5862-4229-9cda-47a9f330e1ca PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:19.409Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fe836054-5862-4229-9cda-47a9f330e1ca ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:19.409Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fe836054-5862-4229-9cda-47a9f330e1ca ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:19.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b7c06e-b51d-4dc3-be7e-2feb12bea157 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:19.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b7c06e-b51d-4dc3-be7e-2feb12bea157 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e28ed52 2021-04-14T11:50:19.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b7c06e-b51d-4dc3-be7e-2feb12bea157 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:19.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b7c06e-b51d-4dc3-be7e-2feb12bea157 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:22.592Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a1b7c06e-b51d-4dc3-be7e-2feb12bea157 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:22.593Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a1b7c06e-b51d-4dc3-be7e-2feb12bea157 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:23.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e7c7af-3d0c-46f5-816f-a35e7d43b8ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:23.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e7c7af-3d0c-46f5-816f-a35e7d43b8ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b43139b 2021-04-14T11:50:23.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e7c7af-3d0c-46f5-816f-a35e7d43b8ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:23.411Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96e7c7af-3d0c-46f5-816f-a35e7d43b8ea PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:24.735Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396) at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51) at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512) at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190) at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194) at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68) at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54) at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44) at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66) at com.google.common.collect.Iterables$4.iterator(Iterables.java:559) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:84) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:50:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:25.941Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Internal Connection problem. Description: Failed to fetch data types from graph(cache) 2021-04-14T11:50:26.426Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=96e7c7af-3d0c-46f5-816f-a35e7d43b8ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:26.426Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=96e7c7af-3d0c-46f5-816f-a35e7d43b8ea ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dec2247-3c7a-440f-8f02-f45b9091961f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dec2247-3c7a-440f-8f02-f45b9091961f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14a8a47f 2021-04-14T11:50:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dec2247-3c7a-440f-8f02-f45b9091961f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dec2247-3c7a-440f-8f02-f45b9091961f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:30.192Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7dec2247-3c7a-440f-8f02-f45b9091961f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:30.193Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7dec2247-3c7a-440f-8f02-f45b9091961f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:31.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11b6f99f-0e77-4558-a4d0-223ee68d709e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:31.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11b6f99f-0e77-4558-a4d0-223ee68d709e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@387f7673 2021-04-14T11:50:31.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11b6f99f-0e77-4558-a4d0-223ee68d709e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:31.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11b6f99f-0e77-4558-a4d0-223ee68d709e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:31.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:33.530Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:50:33.530Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1670) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:832) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:50:33.531Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-04-14T11:50:09.215984Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) ... 8 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) ... 9 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:50:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:34.019Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=11b6f99f-0e77-4558-a4d0-223ee68d709e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:34.020Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=11b6f99f-0e77-4558-a4d0-223ee68d709e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:34.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ac689c0-c65b-4ee7-8ccd-0de9980bb962 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:34.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ac689c0-c65b-4ee7-8ccd-0de9980bb962 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58b0ddd6 2021-04-14T11:50:34.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ac689c0-c65b-4ee7-8ccd-0de9980bb962 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:34.179Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ac689c0-c65b-4ee7-8ccd-0de9980bb962 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:34.598Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012qnnuv58ugsb1lf92a6sgepuo110 2021-04-14T11:50:34.598Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gx2hl4yn81rp1srqmm1es1o2y168 2021-04-14T11:50:34.598Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01o9jd4al6iqcl12d8x5qn153z2171 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node03qi7cwnwxwgzo71ej9bx4yjn114 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0jifvyc61vooiv72bljc6vr36115 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xz2e9d3bpvrwgg2yhvui7yb1152 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04so22ijla9eb1dvl2js6vs26i107 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0104pu0f7zbl691rtg2qd4ke5a9151 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0134qxt0bepkxskb1o6kgkb2gj146 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dc57nc0u512t4vzvmkz9u5z8169 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0b18gzyawnawq2d7wnhnk42xx142 2021-04-14T11:50:34.599Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dnhigxavyai01gd0hqyjqqt1h120 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yzla8j8e5vx9oscijuf68a6g139 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019errbpnj581ll5re1dsd1vuf122 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018l20990a7wyln5acxi0e5x19104 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012zuu2vhosy5rv5c5v7qbkcq3130 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vrtnishvl2jcbxihtmlgoada128 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0g35ey1adr32gu6quh6a71b7w113 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node011uyetkw8xsil1wl6tws4ke5qh135 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01q1a2q30mim3qfp3l4wh0xs6f160 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01j6x7ua5btz1v6jmoyo92zzhm144 2021-04-14T11:50:34.600Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01p8qo4tno5dq93d4d9yibowza105 2021-04-14T11:50:34.601Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node054my4bnx6s3516ml9xe6lfjda148 2021-04-14T11:50:34.603Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node03ec3fnlzp07aw0xhchto1j3w163 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xloq3qvb20pv94eyub1m6x15134 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01u6nxihj99wg185ulpvhyreci140 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tt4240jbbf18kz6qh6681jx9156 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node03jdn9guegmjf1cyp4twzj7glf133 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012bt0yfazig461xcm3wzaebibq150 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0kjxeytbkcqrb121eaaq36jxiv145 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0166rnekjfmn0bfsln2fzz5qlx118 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0149qrg46gl5l4sn3jh86kbg2g124 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012ond58zt9lyjmujmwj96x41j164 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09hud6acnu5o51lor0xwfhvbbe158 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0al5nygmmof921xxrfybbe4b7c172 2021-04-14T11:50:34.604Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cazy6aurfrgcky3ybuwrl94106 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0c1ffcu9vj9pd1tu5qbv6mp8d2167 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0c4iwci81cfkh1ogqenwbfwgga111 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node041g7ghafnfpc1x9nh6i4kyhn7119 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013z0gtvjyttp71ocqb4mneehhv159 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d0sb3ksb4zyu14gujsm1ry7v5162 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01nmci81ip2s7l73gopzhk65xk138 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07d4w458f1fun9wopwfahgpkb143 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01b5qsd7dc4uqmogz9d5by7ubu170 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qtj21p7zo3lz13wz9vvuwplpm129 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0iq5qum1l8v26i8i7nilu3fp7121 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0gbwia572neo8187xcggb2ml8q153 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bf9zh9wl1p3d1ta8swi3jyou2165 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0snp5cm6anw0sxa99v4e6p4al137 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0orkkt53fviqoz8gbfrhqi3i6112 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xjxzexjqw9upfgymlholnlwn131 2021-04-14T11:50:34.605Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0193sp6is1np788i9uwv8p5em157 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0f3im40jvbhj29pdn2rvl5tia123 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08dm1pcn0mhkal730e72h90le132 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vk3cnwy2mvl21f6e8uhgnsmg9147 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ufb9jrduv429pkcy7g3ctaoi141 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01kxj7k7krztkf1gv4jzjg4gztu136 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ifedw3per582sylj1pqsecij127 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01om4yh8l5xtw9124gsv29pwrmu126 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010ez2a49gqs0t4sgxv2epg1c2166 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01uzmknj3d0v9ojdr95nif9w6b149 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hdmdhy4imj3lumdoa7qm46ou154 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0sbn5vxqbkysy1uhzlmp07qkdb125 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dxu7pumy3sur1l40749g6bn1161 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01luttphm8iwpwxiozy7oezqrw116 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ykcwg5z0jfo0gour1le45gqj117 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tpnbyacrygs6mxbr2s1riedf108 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0jpwklfuaqjq1y2hka9h0z92e109 2021-04-14T11:50:34.606Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tz056j0rfzud17ryponoe2qaw155 2021-04-14T11:50:36.237Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=32064010-e0a3-4fc0-8b01-ecbce4bf67a9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:50:36.236959Z InvocationID=4e6f91db-814a-4635-ab50-96cb172d031e LogTimestamp=2021-04-14T11:50:36.237023Z Entering 2021-04-14T11:50:36.237Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=32064010-e0a3-4fc0-8b01-ecbce4bf67a9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:50:36.236959Z InvocationID=4e6f91db-814a-4635-ab50-96cb172d031e LogTimestamp=2021-04-14T11:50:36.237023Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:50:36.238Z [qtp580718781-11] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:50:36.237Z InvocationID=666f9839-c7cd-4307-82e4-9fcc51276737 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:50:36.238Z [qtp580718781-11] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:50:36.238Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:50:36.237Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=666f9839-c7cd-4307-82e4-9fcc51276737 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@7f9ecba7 2021-04-14T11:50:36.238Z [qtp580718781-11] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:50:36.238Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:50:36.237Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=666f9839-c7cd-4307-82e4-9fcc51276737 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@7f9ecba7 2021-04-14T11:50:36.239Z [qtp580718781-11] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:50:36.238948Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:50:36.239Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:50:36.238948Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:50:36.239Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:50:36.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:37.188Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=4ac689c0-c65b-4ee7-8ccd-0de9980bb962 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:37.188Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=4ac689c0-c65b-4ee7-8ccd-0de9980bb962 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:37.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65b10c6-27f9-4ac7-9997-16dd59064bae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:37.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65b10c6-27f9-4ac7-9997-16dd59064bae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4be6cf3a 2021-04-14T11:50:37.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65b10c6-27f9-4ac7-9997-16dd59064bae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:37.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65b10c6-27f9-4ac7-9997-16dd59064bae PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:40.709Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b65b10c6-27f9-4ac7-9997-16dd59064bae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:40.709Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b65b10c6-27f9-4ac7-9997-16dd59064bae ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:40.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e5fbf9-a662-4eb2-8340-e16b7b556f55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:40.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e5fbf9-a662-4eb2-8340-e16b7b556f55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c8b88af 2021-04-14T11:50:40.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e5fbf9-a662-4eb2-8340-e16b7b556f55 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:40.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e5fbf9-a662-4eb2-8340-e16b7b556f55 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:43.356Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE 2021-04-14T11:50:43.357Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 128000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:50:43.964Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=77e5fbf9-a662-4eb2-8340-e16b7b556f55 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:43.964Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=77e5fbf9-a662-4eb2-8340-e16b7b556f55 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:44.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c25e40-85a0-4943-828e-f999c3b9c162 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:44.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c25e40-85a0-4943-828e-f999c3b9c162 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7622b075 2021-04-14T11:50:44.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c25e40-85a0-4943-828e-f999c3b9c162 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:44.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97c25e40-85a0-4943-828e-f999c3b9c162 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:50:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:50:47.833Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=97c25e40-85a0-4943-828e-f999c3b9c162 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:47.834Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=97c25e40-85a0-4943-828e-f999c3b9c162 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:48.503Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96037fad-118a-4a21-a7ec-25f7b581a191 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:48.503Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96037fad-118a-4a21-a7ec-25f7b581a191 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2972d70f 2021-04-14T11:50:48.503Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96037fad-118a-4a21-a7ec-25f7b581a191 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:48.503Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96037fad-118a-4a21-a7ec-25f7b581a191 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:50:50.911Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:50:51.515Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=96037fad-118a-4a21-a7ec-25f7b581a191 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:51.516Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=96037fad-118a-4a21-a7ec-25f7b581a191 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:52.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:52.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4073d763 2021-04-14T11:50:52.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:52.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:55.040Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:55.041Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:55.041Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:50:55.041Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=bc212cb4-69ba-420a-8a96-4e36a938c981 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:50:55.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d023f229-1289-4a6b-85d5-4cd02f153710 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:55.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d023f229-1289-4a6b-85d5-4cd02f153710 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2187a030 2021-04-14T11:50:55.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d023f229-1289-4a6b-85d5-4cd02f153710 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:55.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d023f229-1289-4a6b-85d5-4cd02f153710 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:50:58.615Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d023f229-1289-4a6b-85d5-4cd02f153710 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:50:58.616Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d023f229-1289-4a6b-85d5-4cd02f153710 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:50:58.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5da87824-3c8c-43b8-8429-c864d919f33c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:50:58.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5da87824-3c8c-43b8-8429-c864d919f33c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57dbfac7 2021-04-14T11:50:58.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5da87824-3c8c-43b8-8429-c864d919f33c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:50:58.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5da87824-3c8c-43b8-8429-c864d919f33c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:01.795Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5da87824-3c8c-43b8-8429-c864d919f33c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:01.795Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5da87824-3c8c-43b8-8429-c864d919f33c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:02.060Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eded9d3a-21e7-4df6-8b70-724f47ba3a8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:02.060Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eded9d3a-21e7-4df6-8b70-724f47ba3a8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4309bbb6 2021-04-14T11:51:02.060Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eded9d3a-21e7-4df6-8b70-724f47ba3a8c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:02.060Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eded9d3a-21e7-4df6-8b70-724f47ba3a8c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:51:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:51:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:51:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:51:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:51:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:51:05.068Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eded9d3a-21e7-4df6-8b70-724f47ba3a8c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:05.068Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eded9d3a-21e7-4df6-8b70-724f47ba3a8c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:05.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eab2ebc7-6aee-4567-8c95-35442c489dff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:05.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eab2ebc7-6aee-4567-8c95-35442c489dff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d453bc4 2021-04-14T11:51:05.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eab2ebc7-6aee-4567-8c95-35442c489dff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:05.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eab2ebc7-6aee-4567-8c95-35442c489dff PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:06.251Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=de9ae295-171f-43d5-a64b-04039d34f9a1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:51:06.250976Z InvocationID=e95524e8-449a-4f15-8770-f3bf2ae1d485 LogTimestamp=2021-04-14T11:51:06.251104Z Entering 2021-04-14T11:51:06.252Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=de9ae295-171f-43d5-a64b-04039d34f9a1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:51:06.250976Z InvocationID=e95524e8-449a-4f15-8770-f3bf2ae1d485 LogTimestamp=2021-04-14T11:51:06.251104Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:51:06.255Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:51:06.252Z InvocationID=8e3445a8-fa08-49c9-a27a-cd79ebe66317 LogTimestamp=2021-04-14T11:51:06.255118Z ResponseDesc=OK Exiting. 2021-04-14T11:51:06.255Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:51:08.741Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=eab2ebc7-6aee-4567-8c95-35442c489dff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:08.742Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=eab2ebc7-6aee-4567-8c95-35442c489dff ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:09.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2296ed76-7229-445e-bf94-6f17df7dfa82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:09.396Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2296ed76-7229-445e-bf94-6f17df7dfa82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64796be7 2021-04-14T11:51:09.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2296ed76-7229-445e-bf94-6f17df7dfa82 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:09.397Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2296ed76-7229-445e-bf94-6f17df7dfa82 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:12.404Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=2296ed76-7229-445e-bf94-6f17df7dfa82 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:12.405Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=2296ed76-7229-445e-bf94-6f17df7dfa82 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:51:13.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228a0126-e759-4206-9e94-e3f138892931 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:13.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228a0126-e759-4206-9e94-e3f138892931 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42871425 2021-04-14T11:51:13.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228a0126-e759-4206-9e94-e3f138892931 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:13.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228a0126-e759-4206-9e94-e3f138892931 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:16.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:16.206Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:16.207Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:16.336Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=228a0126-e759-4206-9e94-e3f138892931 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:16.336Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=228a0126-e759-4206-9e94-e3f138892931 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:16.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:16.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a924d25 2021-04-14T11:51:16.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:16.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:18.548Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:51:18.548Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1670) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:832) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:51:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:22.580Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:51:22.581Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:51:22.581Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:51:22.581Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=97b55a76-0b7d-4b3c-b6cf-cc859ceecf43 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:51:23.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85e70db-5484-4459-86ac-bc3b2e34fb4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:23.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85e70db-5484-4459-86ac-bc3b2e34fb4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62356a0e 2021-04-14T11:51:23.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85e70db-5484-4459-86ac-bc3b2e34fb4d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:23.321Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85e70db-5484-4459-86ac-bc3b2e34fb4d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41c0189b-3a4e-40a1-adfd-c8d67ccabdbd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41c0189b-3a4e-40a1-adfd-c8d67ccabdbd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c0ad52 2021-04-14T11:51:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41c0189b-3a4e-40a1-adfd-c8d67ccabdbd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:26.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41c0189b-3a4e-40a1-adfd-c8d67ccabdbd PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:27.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9bea36e-2743-4715-8c7e-39ff4dee70c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:27.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9bea36e-2743-4715-8c7e-39ff4dee70c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55e27fb3 2021-04-14T11:51:27.490Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9bea36e-2743-4715-8c7e-39ff4dee70c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:27.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9bea36e-2743-4715-8c7e-39ff4dee70c4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:27.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:28.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e009e1-f852-4d91-9e4a-1cfc8b97417d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:28.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e009e1-f852-4d91-9e4a-1cfc8b97417d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c4e0a1b 2021-04-14T11:51:28.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e009e1-f852-4d91-9e4a-1cfc8b97417d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:28.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60e009e1-f852-4d91-9e4a-1cfc8b97417d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:28.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb0aafe7-7879-4b84-917f-87faae2dbfc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:28.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb0aafe7-7879-4b84-917f-87faae2dbfc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b7cbec4 2021-04-14T11:51:28.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb0aafe7-7879-4b84-917f-87faae2dbfc1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:28.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb0aafe7-7879-4b84-917f-87faae2dbfc1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:30.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728e684d-1961-4b2a-bf04-3ee723e63c69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:30.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728e684d-1961-4b2a-bf04-3ee723e63c69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@85538c4 2021-04-14T11:51:30.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728e684d-1961-4b2a-bf04-3ee723e63c69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:30.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=728e684d-1961-4b2a-bf04-3ee723e63c69 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:31.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501e8c75-e964-4824-b67c-3ca710ca304b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:31.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501e8c75-e964-4824-b67c-3ca710ca304b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e0cc19a 2021-04-14T11:51:31.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501e8c75-e964-4824-b67c-3ca710ca304b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:31.822Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501e8c75-e964-4824-b67c-3ca710ca304b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:34.825Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=501e8c75-e964-4824-b67c-3ca710ca304b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:51:34.825Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=501e8c75-e964-4824-b67c-3ca710ca304b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:51:35.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962cae0e-8d33-4e9c-81fc-3c4410f155a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:35.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962cae0e-8d33-4e9c-81fc-3c4410f155a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22fe0492 2021-04-14T11:51:35.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962cae0e-8d33-4e9c-81fc-3c4410f155a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:35.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=962cae0e-8d33-4e9c-81fc-3c4410f155a3 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:35.637Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:51:35.744Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Element.keys(Element.java:69) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getProperties(JanusGraphGenericDao.java:1670) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:832) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:51:36.259Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0a561d9d-fc6c-49eb-915e-a0cde18f38f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:51:36.257719Z InvocationID=fa01c913-b5da-4311-bfaf-60a3c46aa997 LogTimestamp=2021-04-14T11:51:36.257839Z Entering 2021-04-14T11:51:36.259Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0a561d9d-fc6c-49eb-915e-a0cde18f38f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:51:36.257719Z InvocationID=fa01c913-b5da-4311-bfaf-60a3c46aa997 LogTimestamp=2021-04-14T11:51:36.257839Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:51:36.260Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:51:36.259Z InvocationID=824ba896-b375-470a-ab5c-89549940f434 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:51:36.261Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:51:36.260Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:51:36.259Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=824ba896-b375-470a-ab5c-89549940f434 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@7ea3028a 2021-04-14T11:51:36.261Z [qtp580718781-15] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:51:36.260Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:51:36.259Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=824ba896-b375-470a-ab5c-89549940f434 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@7ea3028a 2021-04-14T11:51:36.261Z [qtp580718781-15] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:51:36.261860Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:51:36.261Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:51:36.261860Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:51:36.262Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:51:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:38.612Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=962cae0e-8d33-4e9c-81fc-3c4410f155a3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:38.613Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=962cae0e-8d33-4e9c-81fc-3c4410f155a3 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be5160a-8275-40c9-b85d-decda0f1104c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be5160a-8275-40c9-b85d-decda0f1104c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d2896c8 2021-04-14T11:51:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be5160a-8275-40c9-b85d-decda0f1104c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7be5160a-8275-40c9-b85d-decda0f1104c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:51:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:41.842Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:51:42.049Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7be5160a-8275-40c9-b85d-decda0f1104c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:42.050Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7be5160a-8275-40c9-b85d-decda0f1104c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:51:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:51:46.208Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:51:48.227Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=36ced5d6-3849-476f-b52b-aa5542c82764 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:51:48.226879Z InvocationID=7ef7ee0e-b4c5-4c1a-996b-eb5aecd540fb LogTimestamp=2021-04-14T11:51:48.226937Z Entering 2021-04-14T11:51:48.227Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=36ced5d6-3849-476f-b52b-aa5542c82764 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:51:48.226879Z InvocationID=7ef7ee0e-b4c5-4c1a-996b-eb5aecd540fb LogTimestamp=2021-04-14T11:51:48.226937Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:51:48.227Z [qtp580718781-18] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:51:48.227Z InvocationID=11d624a0-a6ee-4111-9d3e-0a73ee8492dc ErrorCode=500 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:51:48.228Z [qtp580718781-18] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=clamp ElapsedTime=1 EndTimestamp=2021-04-14T11:51:48.228Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.228.190 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:51:48.227Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=11d624a0-a6ee-4111-9d3e-0a73ee8492dc ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@7f469554 2021-04-14T11:51:48.228Z [qtp580718781-18] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=clamp ElapsedTime=1 EndTimestamp=2021-04-14T11:51:48.228Z Severity=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.228.190 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:51:48.227Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=11d624a0-a6ee-4111-9d3e-0a73ee8492dc ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@7f469554 2021-04-14T11:51:48.228Z [qtp580718781-18] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:51:48.228508Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:51:48.228Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:51:48.228508Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:51:48.228Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:51:48.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:51.115Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:51:51.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d66f83a-7145-495a-963c-af2080447744 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:51.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d66f83a-7145-495a-963c-af2080447744 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1788cc40 2021-04-14T11:51:51.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d66f83a-7145-495a-963c-af2080447744 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:51.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d66f83a-7145-495a-963c-af2080447744 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:51:54.553Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7d66f83a-7145-495a-963c-af2080447744 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:54.553Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7d66f83a-7145-495a-963c-af2080447744 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:51:54.553Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7d66f83a-7145-495a-963c-af2080447744 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:51:54.553Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=7d66f83a-7145-495a-963c-af2080447744 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:51:55.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1e3e89-ac4e-43ef-9982-0d543f57fa70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:51:55.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1e3e89-ac4e-43ef-9982-0d543f57fa70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@221d05f1 2021-04-14T11:51:55.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1e3e89-ac4e-43ef-9982-0d543f57fa70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:51:55.330Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca1e3e89-ac4e-43ef-9982-0d543f57fa70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:51:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:51:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:51:58.337Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ca1e3e89-ac4e-43ef-9982-0d543f57fa70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:51:58.337Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ca1e3e89-ac4e-43ef-9982-0d543f57fa70 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:52:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:01.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:01.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32b0c603 2021-04-14T11:52:01.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:01.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:02.838Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:52:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:52:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:52:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:52:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:52:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:52:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:52:04.953Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:52:04.953Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:04.953Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:52:04.953Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=51334b59-60ef-42e9-a33c-b798e5cd6ea8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:52:06.254Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e4c66f90-dfd4-4569-a2e5-87cf7a298aad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:52:06.254024Z InvocationID=b75f10d2-71cf-47c8-a4ae-1610f41adb85 LogTimestamp=2021-04-14T11:52:06.254150Z Entering 2021-04-14T11:52:06.255Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e4c66f90-dfd4-4569-a2e5-87cf7a298aad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:52:06.254024Z InvocationID=b75f10d2-71cf-47c8-a4ae-1610f41adb85 LogTimestamp=2021-04-14T11:52:06.254150Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:52:06.258Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:52:06.255Z InvocationID=73cc9781-7377-4cfa-a592-120ee0d04a38 LogTimestamp=2021-04-14T11:52:06.258817Z ResponseDesc=OK Exiting. 2021-04-14T11:52:06.259Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:52:06.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:06.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21df204b 2021-04-14T11:52:06.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:06.433Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:09.445Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:52:09.446Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:09.446Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:52:09.446Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=30d9dfbe-c54c-4437-afe4-8500fc5f3895 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:52:10.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e4354d-a31f-4cae-8851-91a046259f02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:10.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e4354d-a31f-4cae-8851-91a046259f02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29bb896e 2021-04-14T11:52:10.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e4354d-a31f-4cae-8851-91a046259f02 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:10.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62e4354d-a31f-4cae-8851-91a046259f02 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:16.545Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=62e4354d-a31f-4cae-8851-91a046259f02 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:52:16.545Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=62e4354d-a31f-4cae-8851-91a046259f02 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:52:18.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf65880-b826-46e7-aefb-3d425b38b8ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:18.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf65880-b826-46e7-aefb-3d425b38b8ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26dc99f8 2021-04-14T11:52:18.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf65880-b826-46e7-aefb-3d425b38b8ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:18.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bf65880-b826-46e7-aefb-3d425b38b8ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:21.246Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=9bf65880-b826-46e7-aefb-3d425b38b8ba ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:52:21.246Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=9bf65880-b826-46e7-aefb-3d425b38b8ba ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:52:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:52:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:52:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=069b9ea8-505e-414c-8c82-e40146733656 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=069b9ea8-505e-414c-8c82-e40146733656 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3095f7d0 2021-04-14T11:52:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=069b9ea8-505e-414c-8c82-e40146733656 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:27.571Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=069b9ea8-505e-414c-8c82-e40146733656 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:27.785Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:52:30.582Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=069b9ea8-505e-414c-8c82-e40146733656 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:52:30.583Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=069b9ea8-505e-414c-8c82-e40146733656 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:31.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244349a4-19e5-4284-b5aa-52a291f634ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:31.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244349a4-19e5-4284-b5aa-52a291f634ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@453259ac 2021-04-14T11:52:31.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244349a4-19e5-4284-b5aa-52a291f634ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:31.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244349a4-19e5-4284-b5aa-52a291f634ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:34.946Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=244349a4-19e5-4284-b5aa-52a291f634ba ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:52:34.947Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=244349a4-19e5-4284-b5aa-52a291f634ba ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:36.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=120032c0-eec3-45b4-8ed4-b5b31c735da8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:36.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=120032c0-eec3-45b4-8ed4-b5b31c735da8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1863e4ec 2021-04-14T11:52:36.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=120032c0-eec3-45b4-8ed4-b5b31c735da8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:36.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=120032c0-eec3-45b4-8ed4-b5b31c735da8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:36.250Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ed629360-2af0-42bc-be9e-d0d6bec9ad5d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:52:36.250014Z InvocationID=9ddfa885-bc6c-45fa-a616-6c5be1923e4b LogTimestamp=2021-04-14T11:52:36.250090Z Entering 2021-04-14T11:52:36.250Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ed629360-2af0-42bc-be9e-d0d6bec9ad5d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:52:36.250014Z InvocationID=9ddfa885-bc6c-45fa-a616-6c5be1923e4b LogTimestamp=2021-04-14T11:52:36.250090Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:52:36.252Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:52:36.250Z InvocationID=80f445e4-758d-436a-a209-98c7b2ab69aa LogTimestamp=2021-04-14T11:52:36.252609Z ResponseDesc=OK Exiting. 2021-04-14T11:52:36.252Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:52:39.241Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=120032c0-eec3-45b4-8ed4-b5b31c735da8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:52:39.242Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=120032c0-eec3-45b4-8ed4-b5b31c735da8 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:52:39.817Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:52:39.817Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:52:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:52:44.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e34c8f-d21f-462e-a74d-d862cd8ec9c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:44.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e34c8f-d21f-462e-a74d-d862cd8ec9c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@502846ef 2021-04-14T11:52:44.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e34c8f-d21f-462e-a74d-d862cd8ec9c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:44.178Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92e34c8f-d21f-462e-a74d-d862cd8ec9c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:45.682Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:52:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:52:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:52:47.190Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=92e34c8f-d21f-462e-a74d-d862cd8ec9c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:52:47.191Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=92e34c8f-d21f-462e-a74d-d862cd8ec9c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:52:48.254Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e2ef8c-31b2-4db5-9a6e-5a7f1ee5f64e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:48.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e2ef8c-31b2-4db5-9a6e-5a7f1ee5f64e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d43b353 2021-04-14T11:52:48.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e2ef8c-31b2-4db5-9a6e-5a7f1ee5f64e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:48.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50e2ef8c-31b2-4db5-9a6e-5a7f1ee5f64e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:50.738Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=50e2ef8c-31b2-4db5-9a6e-5a7f1ee5f64e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:52:50.738Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=50e2ef8c-31b2-4db5-9a6e-5a7f1ee5f64e ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:52:51.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68efa4ae-38f3-4510-85a6-846c1cbeac15 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:51.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68efa4ae-38f3-4510-85a6-846c1cbeac15 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cc9c628 2021-04-14T11:52:51.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68efa4ae-38f3-4510-85a6-846c1cbeac15 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:51.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68efa4ae-38f3-4510-85a6-846c1cbeac15 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:54.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9045bbd9-a9a3-44b3-92a4-33b0cef8718e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:54.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9045bbd9-a9a3-44b3-92a4-33b0cef8718e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15d39cfc 2021-04-14T11:52:54.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9045bbd9-a9a3-44b3-92a4-33b0cef8718e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:54.356Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9045bbd9-a9a3-44b3-92a4-33b0cef8718e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:55.501Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad999ca3-1dba-487c-80f2-630d55b2f052 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:55.501Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad999ca3-1dba-487c-80f2-630d55b2f052 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65fa6c3e 2021-04-14T11:52:55.501Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad999ca3-1dba-487c-80f2-630d55b2f052 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:55.501Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad999ca3-1dba-487c-80f2-630d55b2f052 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:52:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ca697c2 2021-04-14T11:52:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:52:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:52:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:52:57.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:52:59.802Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:52:59.802Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:52:59.802Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:52:59.802Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=33492333-6d0a-48ce-ae1a-7021840e4199 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:53:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:53:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:53:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:53:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:53:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:53:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:53:06.252Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=28b57f85-fe90-42ce-a2c6-7e2654562604 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:53:06.252388Z InvocationID=f960fae2-3913-4938-b0a1-92be455fb055 LogTimestamp=2021-04-14T11:53:06.252456Z Entering 2021-04-14T11:53:06.253Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=28b57f85-fe90-42ce-a2c6-7e2654562604 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:53:06.252388Z InvocationID=f960fae2-3913-4938-b0a1-92be455fb055 LogTimestamp=2021-04-14T11:53:06.252456Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:53:06.253Z [qtp580718781-13] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:53:06.253Z InvocationID=b91eb054-bcdf-4565-9a5c-dee97909316d ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:53:06.254Z [qtp580718781-13] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:53:06.254Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:53:06.253Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b91eb054-bcdf-4565-9a5c-dee97909316d ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@3f2f82 2021-04-14T11:53:06.254Z [qtp580718781-13] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:53:06.254Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:53:06.253Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=b91eb054-bcdf-4565-9a5c-dee97909316d ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@3f2f82 2021-04-14T11:53:06.255Z [qtp580718781-13] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:53:06.255063Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:53:06.255Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:53:06.255063Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:53:06.255Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:53:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:09.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:15.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:19.836Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.70.81:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:53:19.837Z [cluster1-timeouter-0] WARN com.datastax.driver.core.Session Error creating pool to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.ConnectionException: [cassandra.onap/10.242.70.81:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1080) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.google.common.util.concurrent.CollectionFuture.handleAllCompleted(CollectionFuture.java:69) at com.google.common.util.concurrent.AggregateFuture.processCompleted(AggregateFuture.java:282) at com.google.common.util.concurrent.AggregateFuture.decrementCountAndMaybeComplete(AggregateFuture.java:264) at com.google.common.util.concurrent.AggregateFuture.access$200(AggregateFuture.java:42) at com.google.common.util.concurrent.AggregateFuture$1.run(AggregateFuture.java:147) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:814) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:203) at com.google.common.util.concurrent.AbstractCatchingFuture$AsyncCatchingFuture.setResult(AbstractCatchingFuture.java:179) at com.google.common.util.concurrent.AbstractCatchingFuture.run(AbstractCatchingFuture.java:133) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:100) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:771) at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:53:19.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:19.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e6cecf8 2021-04-14T11:53:19.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:19.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:53:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:22.886Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:53:22.886Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:53:22.886Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:53:22.886Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f137d5aa-162c-42a3-a4cc-a2c11eb5bc8f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:53:23.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f4b1af-d960-4e13-a2b9-3766130834db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:23.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f4b1af-d960-4e13-a2b9-3766130834db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@217cb2ed 2021-04-14T11:53:23.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f4b1af-d960-4e13-a2b9-3766130834db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:23.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f4b1af-d960-4e13-a2b9-3766130834db PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:53:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:26.755Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=68f4b1af-d960-4e13-a2b9-3766130834db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:53:26.755Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=68f4b1af-d960-4e13-a2b9-3766130834db ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:53:27.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01d89ecd-6ab1-4dc7-b08f-acb9efba800b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:27.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01d89ecd-6ab1-4dc7-b08f-acb9efba800b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@400e097c 2021-04-14T11:53:27.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01d89ecd-6ab1-4dc7-b08f-acb9efba800b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:27.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01d89ecd-6ab1-4dc7-b08f-acb9efba800b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:53:27.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:30.067Z [cluster1-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:53:30.068Z [cluster1-reconnection-1] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 2000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:53:30.072Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:53:30.626Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=01d89ecd-6ab1-4dc7-b08f-acb9efba800b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:53:30.627Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=01d89ecd-6ab1-4dc7-b08f-acb9efba800b ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:53:30.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:31.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:31.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:31.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95c1d0a-0ddd-4223-8619-38dc8583f865 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:31.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95c1d0a-0ddd-4223-8619-38dc8583f865 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e57d8af 2021-04-14T11:53:31.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95c1d0a-0ddd-4223-8619-38dc8583f865 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:31.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c95c1d0a-0ddd-4223-8619-38dc8583f865 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:53:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=674bc9fa-4dbe-4700-81ea-2e6a6c1b775b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=674bc9fa-4dbe-4700-81ea-2e6a6c1b775b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@764acea1 2021-04-14T11:53:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=674bc9fa-4dbe-4700-81ea-2e6a6c1b775b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=674bc9fa-4dbe-4700-81ea-2e6a6c1b775b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:53:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:53:34.143Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=674bc9fa-4dbe-4700-81ea-2e6a6c1b775b ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:53:34.143Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=674bc9fa-4dbe-4700-81ea-2e6a6c1b775b ErrorCategory=ERROR ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:53:34.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6398ede-f159-47ad-99a4-18cc09d7d5fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:34.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6398ede-f159-47ad-99a4-18cc09d7d5fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b396465 2021-04-14T11:53:34.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6398ede-f159-47ad-99a4-18cc09d7d5fb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:34.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6398ede-f159-47ad-99a4-18cc09d7d5fb PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:53:36.235Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0746eaab-ab31-4295-8ab0-c4a36ef95b86 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:53:36.234325Z InvocationID=89656610-ac20-4a3c-9708-7d4d7ce01cf1 LogTimestamp=2021-04-14T11:53:36.234502Z Entering 2021-04-14T11:53:36.235Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0746eaab-ab31-4295-8ab0-c4a36ef95b86 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:53:36.234325Z InvocationID=89656610-ac20-4a3c-9708-7d4d7ce01cf1 LogTimestamp=2021-04-14T11:53:36.234502Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:53:36.236Z [qtp580718781-11] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:53:36.235Z InvocationID=5fb2503f-33f9-4782-b336-0cb204c09f51 ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:53:36.237Z [qtp580718781-11] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:53:36.236Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:53:36.235Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=5fb2503f-33f9-4782-b336-0cb204c09f51 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@6fb19233 2021-04-14T11:53:36.237Z [qtp580718781-11] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:53:36.236Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:53:36.235Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=5fb2503f-33f9-4782-b336-0cb204c09f51 ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@6fb19233 2021-04-14T11:53:36.237Z [qtp580718781-11] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:53:36.237491Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:53:36.237Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:53:36.237491Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:53:36.238Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:53:37.032Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:53:39.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d647fc0f-e129-4a09-9390-4522fef0fc37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:39.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d647fc0f-e129-4a09-9390-4522fef0fc37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b8b5b0d 2021-04-14T11:53:39.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d647fc0f-e129-4a09-9390-4522fef0fc37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:39.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d647fc0f-e129-4a09-9390-4522fef0fc37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:41.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d647fc0f-e129-4a09-9390-4522fef0fc37 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:53:41.052Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d647fc0f-e129-4a09-9390-4522fef0fc37 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:53:42.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6882813b-52d1-49d0-882c-545f69aec3c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:42.626Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6882813b-52d1-49d0-882c-545f69aec3c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76de58fd 2021-04-14T11:53:42.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6882813b-52d1-49d0-882c-545f69aec3c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:42.627Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6882813b-52d1-49d0-882c-545f69aec3c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:44.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4aa6e2-75f6-4e54-8c04-f30bc7b728e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:44.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4aa6e2-75f6-4e54-8c04-f30bc7b728e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56c1af41 2021-04-14T11:53:44.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4aa6e2-75f6-4e54-8c04-f30bc7b728e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:44.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f4aa6e2-75f6-4e54-8c04-f30bc7b728e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:46.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:53:46.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:53:47.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d1074b8-2f5c-458f-8081-e1f04f077bcf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:47.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d1074b8-2f5c-458f-8081-e1f04f077bcf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@767bf3b0 2021-04-14T11:53:47.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d1074b8-2f5c-458f-8081-e1f04f077bcf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:47.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d1074b8-2f5c-458f-8081-e1f04f077bcf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:48.242Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=371ea4d7-e35d-4a87-9562-14182f1841ce InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:53:48.242590Z InvocationID=f2e8ae7a-ab33-49d2-99a3-4e095afa3118 LogTimestamp=2021-04-14T11:53:48.242664Z Entering 2021-04-14T11:53:48.243Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=371ea4d7-e35d-4a87-9562-14182f1841ce InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:53:48.242590Z InvocationID=f2e8ae7a-ab33-49d2-99a3-4e095afa3118 LogTimestamp=2021-04-14T11:53:48.242664Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:53:48.245Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:53:48.243Z InvocationID=0d54e89e-19dd-43a4-a29b-ffd942a5c6c2 LogTimestamp=2021-04-14T11:53:48.245548Z ResponseDesc=OK Exiting. 2021-04-14T11:53:48.245Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:53:54.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a555b0-2dc7-46d1-96e6-93cca25aef5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:54.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a555b0-2dc7-46d1-96e6-93cca25aef5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67398d41 2021-04-14T11:53:54.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a555b0-2dc7-46d1-96e6-93cca25aef5e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:54.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2a555b0-2dc7-46d1-96e6-93cca25aef5e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:55.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b956cf4f-bfe5-4e9f-b53d-ae84cc841259 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:55.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b956cf4f-bfe5-4e9f-b53d-ae84cc841259 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63a438eb 2021-04-14T11:53:55.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b956cf4f-bfe5-4e9f-b53d-ae84cc841259 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:55.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b956cf4f-bfe5-4e9f-b53d-ae84cc841259 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:56.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48d8ac39-abcc-41ff-a08b-a9f56606404c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:56.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48d8ac39-abcc-41ff-a08b-a9f56606404c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38442879 2021-04-14T11:53:56.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48d8ac39-abcc-41ff-a08b-a9f56606404c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:56.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48d8ac39-abcc-41ff-a08b-a9f56606404c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:57.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e83cd-4ddc-4c89-9f8b-8428826a75e0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:57.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e83cd-4ddc-4c89-9f8b-8428826a75e0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@118bbab2 2021-04-14T11:53:57.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e83cd-4ddc-4c89-9f8b-8428826a75e0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:57.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e83cd-4ddc-4c89-9f8b-8428826a75e0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:58.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a363b1-48b4-4a9b-9b43-adf88280fe4d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:58.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a363b1-48b4-4a9b-9b43-adf88280fe4d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3af36e47 2021-04-14T11:53:58.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a363b1-48b4-4a9b-9b43-adf88280fe4d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:58.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5a363b1-48b4-4a9b-9b43-adf88280fe4d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:53:59.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:53:59.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78d26a92 2021-04-14T11:53:59.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:53:59.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:02.109Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:54:02.109Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:54:02.109Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:54:02.110Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=6f7a6b8e-e7ae-41a8-9340-6627a90f6285 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:54:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:54:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:54:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:54:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:54:04.358Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:54:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:54:06.331Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=eaed2d77-dfcd-4921-8eca-13f683106f69 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:54:06.331345Z InvocationID=86df2520-2e94-4291-9891-5a0b75b37983 LogTimestamp=2021-04-14T11:54:06.331399Z Entering 2021-04-14T11:54:06.331Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=eaed2d77-dfcd-4921-8eca-13f683106f69 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:54:06.331345Z InvocationID=86df2520-2e94-4291-9891-5a0b75b37983 LogTimestamp=2021-04-14T11:54:06.331399Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:54:06.332Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:54:06.331Z InvocationID=a57a3e68-8f51-47f9-9241-d2ad55ab955e LogTimestamp=2021-04-14T11:54:06.332887Z ResponseDesc=OK Exiting. 2021-04-14T11:54:06.333Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:54:08.729Z [JanusGraph-Health-Check-Task] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$VertexConstructor.get(StandardJanusGraphTx.java:462) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$VertexConstructor.get(StandardJanusGraphTx.java:440) at org.janusgraph.graphdb.transaction.vertexcache.GuavaVertexCache.get(GuavaVertexCache.java:77) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx.getVertex(StandardJanusGraphTx.java:387) at org.janusgraph.graphdb.vertices.AbstractVertex.it(AbstractVertex.java:53) at org.janusgraph.graphdb.vertices.AbstractVertex.it(AbstractVertex.java:37) at org.janusgraph.graphdb.internal.AbstractElement.isRemoved(AbstractElement.java:141) at org.janusgraph.graphdb.vertices.AbstractVertex.verifyAccess(AbstractVertex.java:89) at org.janusgraph.graphdb.vertices.AbstractVertex.query(AbstractVertex.java:137) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient.isGraphOpen(JanusGraphClient.java:346) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckScheduledTask.run(JanusGraphClient.java:95) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:54:10.345Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e420c9d9-03ea-4418-9291-e2b1df4024ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:10.345Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e420c9d9-03ea-4418-9291-e2b1df4024ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61cc8211 2021-04-14T11:54:10.345Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e420c9d9-03ea-4418-9291-e2b1df4024ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:10.345Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e420c9d9-03ea-4418-9291-e2b1df4024ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:10.732Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e420c9d9-03ea-4418-9291-e2b1df4024ee ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:54:10.732Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=e420c9d9-03ea-4418-9291-e2b1df4024ee ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:54:11.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e3ed9d2-51d2-4331-ba18-2f46ef23e7ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:11.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e3ed9d2-51d2-4331-ba18-2f46ef23e7ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cfe281a 2021-04-14T11:54:11.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e3ed9d2-51d2-4331-ba18-2f46ef23e7ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:11.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e3ed9d2-51d2-4331-ba18-2f46ef23e7ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:12.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ab26d6-c6d8-43b1-8dfb-452757cbef99 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:12.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ab26d6-c6d8-43b1-8dfb-452757cbef99 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@679345ed 2021-04-14T11:54:12.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ab26d6-c6d8-43b1-8dfb-452757cbef99 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:12.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ab26d6-c6d8-43b1-8dfb-452757cbef99 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:13.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44fa057-6702-4887-9cc1-4ebe132095d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:13.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44fa057-6702-4887-9cc1-4ebe132095d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@624a9f04 2021-04-14T11:54:13.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44fa057-6702-4887-9cc1-4ebe132095d1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:13.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c44fa057-6702-4887-9cc1-4ebe132095d1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:16.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acbe6687-d795-4a6b-ba7a-9a1b40f3cfe7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:16.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acbe6687-d795-4a6b-ba7a-9a1b40f3cfe7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@389be287 2021-04-14T11:54:16.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acbe6687-d795-4a6b-ba7a-9a1b40f3cfe7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:16.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acbe6687-d795-4a6b-ba7a-9a1b40f3cfe7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:19.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026ca770-79d1-4082-a71e-401d8bbf344d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:19.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026ca770-79d1-4082-a71e-401d8bbf344d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4558b376 2021-04-14T11:54:19.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026ca770-79d1-4082-a71e-401d8bbf344d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:19.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026ca770-79d1-4082-a71e-401d8bbf344d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f6c9a7-f8b9-4b34-a74f-23b2ff48a733 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f6c9a7-f8b9-4b34-a74f-23b2ff48a733 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38193a1d 2021-04-14T11:54:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f6c9a7-f8b9-4b34-a74f-23b2ff48a733 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:23.150Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01f6c9a7-f8b9-4b34-a74f-23b2ff48a733 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:24.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6025b6a-dcbe-47fe-8679-7867f733e39c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:24.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6025b6a-dcbe-47fe-8679-7867f733e39c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e9d30a5 2021-04-14T11:54:24.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6025b6a-dcbe-47fe-8679-7867f733e39c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:24.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6025b6a-dcbe-47fe-8679-7867f733e39c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:25.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5972d211-b396-4d79-8a90-f990b875e68f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:25.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5972d211-b396-4d79-8a90-f990b875e68f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6975642b 2021-04-14T11:54:25.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5972d211-b396-4d79-8a90-f990b875e68f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:25.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5972d211-b396-4d79-8a90-f990b875e68f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a05ffcdc-1b0a-4a47-85d2-6f412364f55a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a05ffcdc-1b0a-4a47-85d2-6f412364f55a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69b6a970 2021-04-14T11:54:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a05ffcdc-1b0a-4a47-85d2-6f412364f55a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:27.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a05ffcdc-1b0a-4a47-85d2-6f412364f55a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:28.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecb5414-b66a-428c-ad24-50acc8fdf16f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:28.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecb5414-b66a-428c-ad24-50acc8fdf16f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@188ebf89 2021-04-14T11:54:28.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecb5414-b66a-428c-ad24-50acc8fdf16f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:28.098Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ecb5414-b66a-428c-ad24-50acc8fdf16f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:28.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fdfcae7-26d9-485f-b7b2-649a39dd90b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:28.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fdfcae7-26d9-485f-b7b2-649a39dd90b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f71ac25 2021-04-14T11:54:28.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fdfcae7-26d9-485f-b7b2-649a39dd90b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:28.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fdfcae7-26d9-485f-b7b2-649a39dd90b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:29.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff96ac4f-f549-40f2-b8df-8b28b86bd09f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:29.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff96ac4f-f549-40f2-b8df-8b28b86bd09f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3de7cbdc 2021-04-14T11:54:29.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff96ac4f-f549-40f2-b8df-8b28b86bd09f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:29.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff96ac4f-f549-40f2-b8df-8b28b86bd09f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c051636c-cb40-4e69-9ed4-995c2d0a8f83 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c051636c-cb40-4e69-9ed4-995c2d0a8f83 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61c60839 2021-04-14T11:54:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c051636c-cb40-4e69-9ed4-995c2d0a8f83 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:31.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c051636c-cb40-4e69-9ed4-995c2d0a8f83 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:31.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:32.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ff252ca-3991-4679-9c34-9bd43d8e1716 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:32.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ff252ca-3991-4679-9c34-9bd43d8e1716 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c59817f 2021-04-14T11:54:32.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ff252ca-3991-4679-9c34-9bd43d8e1716 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:32.442Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ff252ca-3991-4679-9c34-9bd43d8e1716 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:34.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:34.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ebb0455 2021-04-14T11:54:34.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:34.154Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:54:36.389Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=513cefcc-9189-4bec-9e97-dcfa3dceecf0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:54:36.388965Z InvocationID=f8475b44-90e0-47d3-a546-df035687c3e5 LogTimestamp=2021-04-14T11:54:36.389026Z Entering 2021-04-14T11:54:36.389Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=513cefcc-9189-4bec-9e97-dcfa3dceecf0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:54:36.388965Z InvocationID=f8475b44-90e0-47d3-a546-df035687c3e5 LogTimestamp=2021-04-14T11:54:36.389026Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:54:36.390Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:54:36.389Z InvocationID=dd669fc4-52cb-4817-a251-30485e67dac0 LogTimestamp=2021-04-14T11:54:36.390513Z ResponseDesc=OK Exiting. 2021-04-14T11:54:36.391Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:54:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:54:37.157Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:54:37.157Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:54:37.157Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:54:37.157Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=ba80ab74-e8d1-4b3d-9d3b-8b2c3477d866 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:54:39.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:42.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:45.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:46.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:46.204Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:46.205Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:54:46.206Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:54:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:51.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:54:57.234Z [cluster1-timeouter-0] WARN c.d.driver.core.HostConnectionPool Error creating connection to cassandra.onap/10.242.70.81:9042 com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra.onap/10.242.70.81:9042] Operation timed out at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1526) at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1605) at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672) at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747) at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:54:57.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:54:57.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d819975 2021-04-14T11:54:57.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:54:57.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:54:57.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:00.275Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:00.275Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:00.276Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:00.276Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=5ccb547f-fc32-4897-9d7b-da60a9fcf6ee ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:55:00.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ace0e9e-1dc1-4fb1-ba23-4cb01f9b09f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:00.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ace0e9e-1dc1-4fb1-ba23-4cb01f9b09f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c45ffb0 2021-04-14T11:55:00.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ace0e9e-1dc1-4fb1-ba23-4cb01f9b09f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:00.516Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ace0e9e-1dc1-4fb1-ba23-4cb01f9b09f9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:00.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:03.556Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=6ace0e9e-1dc1-4fb1-ba23-4cb01f9b09f9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:03.557Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=6ace0e9e-1dc1-4fb1-ba23-4cb01f9b09f9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:03.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:04.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2dcab-7324-4216-a5a6-378ecfe77c93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:04.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2dcab-7324-4216-a5a6-378ecfe77c93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bc1a5ca 2021-04-14T11:55:04.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2dcab-7324-4216-a5a6-378ecfe77c93 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:04.328Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2dcab-7324-4216-a5a6-378ecfe77c93 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:55:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:55:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:55:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:55:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:55:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:55:06.240Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=14724191-17b0-443d-b42a-df6225399415 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:55:06.239827Z InvocationID=eb045ad1-fca9-4f76-85b3-91b3b0a17835 LogTimestamp=2021-04-14T11:55:06.239927Z Entering 2021-04-14T11:55:06.240Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=14724191-17b0-443d-b42a-df6225399415 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:55:06.239827Z InvocationID=eb045ad1-fca9-4f76-85b3-91b3b0a17835 LogTimestamp=2021-04-14T11:55:06.239927Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:55:06.241Z [qtp580718781-19] ERROR o.o.s.b.f.ComponentsAvailabilityFilter RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes TargetServiceName=null EntryTimestamp=2021-04-14T11:55:06.240Z InvocationID=4250a753-d248-4e5a-85b6-ce78d049d94a ErrorCode=500 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=null Components Availability Filter Failed - ES/Cassandra is DOWN 2021-04-14T11:55:06.241Z [qtp580718781-19] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:55:06.241Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:55:06.240Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=4250a753-d248-4e5a-85b6-ce78d049d94a ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@1b59aa8f 2021-04-14T11:55:06.241Z [qtp580718781-19] ERROR o.o.s.b.f.ComponentsAvailabilityFilter ResponseCode=500 RequestID=null InstanceID=multicloud-k8s-id ElapsedTime=1 EndTimestamp=2021-04-14T11:55:06.241Z Severity=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=false ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR TargetEntity=null RemoteHost=10.242.62.156 ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes ServiceInstanceID=null TargetServiceName=null EntryTimestamp=2021-04-14T11:55:06.240Z ClassName=org.openecomp.sdc.be.filters.ComponentsAvailabilityFilter InvocationID=4250a753-d248-4e5a-85b6-ce78d049d94a ErrorCode=500 ResponseDesc=Internal Server Error org.openecomp.sdc.exception.ResponseFormat$RequestErrorWrapper@1b59aa8f 2021-04-14T11:55:06.242Z [qtp580718781-19] WARN o.onap.logging.filter.base.MDCSetup ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:55:06.242105Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Unable to calculate elapsed time due to error: text 2021-04-14T11:55:06.242Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=500 ServerIPAddress=10.242.62.146 ErrorDesc=Internal Server Error ErrorCode=500 LogTimestamp=2021-04-14T11:55:06.242105Z ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=ERROR ResponseDesc=Internal Server Error Exiting. 2021-04-14T11:55:06.242Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="500" 2021-04-14T11:55:06.816Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:07.366Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=72f2dcab-7324-4216-a5a6-378ecfe77c93 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:07.366Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=72f2dcab-7324-4216-a5a6-378ecfe77c93 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:07.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07879948-73f1-4946-9dda-2cdfc7cca5ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:07.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07879948-73f1-4946-9dda-2cdfc7cca5ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6af61f51 2021-04-14T11:55:07.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07879948-73f1-4946-9dda-2cdfc7cca5ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:07.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07879948-73f1-4946-9dda-2cdfc7cca5ee PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:09.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408bcff0-646f-4900-b35e-905efeb4fb64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:09.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408bcff0-646f-4900-b35e-905efeb4fb64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40f70dfb 2021-04-14T11:55:09.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408bcff0-646f-4900-b35e-905efeb4fb64 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:09.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=408bcff0-646f-4900-b35e-905efeb4fb64 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:09.814Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:10.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22097d-927e-45e4-be78-5ba76d5fb3e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:10.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22097d-927e-45e4-be78-5ba76d5fb3e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d050ff 2021-04-14T11:55:10.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22097d-927e-45e4-be78-5ba76d5fb3e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:10.420Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b22097d-927e-45e4-be78-5ba76d5fb3e9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:11.509Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0b330c-ebe5-421e-aa45-0008724b4174 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:11.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0b330c-ebe5-421e-aa45-0008724b4174 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d06dbc3 2021-04-14T11:55:11.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0b330c-ebe5-421e-aa45-0008724b4174 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:11.510Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e0b330c-ebe5-421e-aa45-0008724b4174 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:12.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29432bb6-59e8-43cb-8abe-768910d7e2e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:12.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29432bb6-59e8-43cb-8abe-768910d7e2e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b66b7f3 2021-04-14T11:55:12.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29432bb6-59e8-43cb-8abe-768910d7e2e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:12.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29432bb6-59e8-43cb-8abe-768910d7e2e6 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:12.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:13.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d81668-2fe4-4b67-87ac-793d332a5e13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:13.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d81668-2fe4-4b67-87ac-793d332a5e13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2306e1b1 2021-04-14T11:55:13.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d81668-2fe4-4b67-87ac-793d332a5e13 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:13.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d81668-2fe4-4b67-87ac-793d332a5e13 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:14.137Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:55:14.138Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 2000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:55:14.141Z [pool-8-thread-1] WARN o.j.diskstorage.log.kcvs.KCVSLog Could not read messages for timestamp [2021-04-14T11:54:59.511404Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:56) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:158) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:726) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:100) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) ... 8 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:792) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:789) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:147) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:161) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) ... 9 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:55:14.141Z [ApplicationDataTypeCacheThread-1] INFO o.j.d.util.BackendOperation RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396) at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51) at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512) at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190) at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194) at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68) at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54) at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44) at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66) at com.google.common.collect.Iterables$4.iterator(Iterables.java:559) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphGenericDao.getByCriteria(JanusGraphGenericDao.java:826) at org.openecomp.sdc.be.model.operations.impl.PropertyOperation.getAllDataTypeNodes(PropertyOperation.java:1988) at org.openecomp.sdc.be.model.cache.ApplicationDataTypeCache.run(ApplicationDataTypeCache.java:212) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:308) at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:422) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 26 common frames omitted 2021-04-14T11:55:15.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=267b55b3-2197-4b33-9af8-99c6886ab1aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:15.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=267b55b3-2197-4b33-9af8-99c6886ab1aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26541a86 2021-04-14T11:55:15.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=267b55b3-2197-4b33-9af8-99c6886ab1aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:15.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=267b55b3-2197-4b33-9af8-99c6886ab1aa PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:15.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c658b4b9-9827-48eb-ad61-07eeeb0d4034 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:15.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c658b4b9-9827-48eb-ad61-07eeeb0d4034 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4de7054c 2021-04-14T11:55:15.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c658b4b9-9827-48eb-ad61-07eeeb0d4034 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:15.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c658b4b9-9827-48eb-ad61-07eeeb0d4034 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:15.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:16.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9ce557-7f18-4137-a53d-700e77d02178 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:16.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9ce557-7f18-4137-a53d-700e77d02178 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23d0fa2c 2021-04-14T11:55:16.491Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9ce557-7f18-4137-a53d-700e77d02178 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:16.492Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9ce557-7f18-4137-a53d-700e77d02178 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:17.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dffdfc-aa5a-4026-b4fc-6e05bd8f9b3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:17.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dffdfc-aa5a-4026-b4fc-6e05bd8f9b3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37cf8c8e 2021-04-14T11:55:17.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dffdfc-aa5a-4026-b4fc-6e05bd8f9b3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:17.306Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8dffdfc-aa5a-4026-b4fc-6e05bd8f9b3f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:17.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd5c24-7d89-4ddc-afe6-ca749d51f75f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:17.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd5c24-7d89-4ddc-afe6-ca749d51f75f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31c930db 2021-04-14T11:55:17.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd5c24-7d89-4ddc-afe6-ca749d51f75f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:17.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd5c24-7d89-4ddc-afe6-ca749d51f75f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:18.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:20.441Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [VertexIndexQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:399) at org.janusgraph.diskstorage.BackendTransaction$5.call(BackendTransaction.java:396) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.indexQuery(BackendTransaction.java:396) at org.janusgraph.graphdb.query.graph.MultiKeySliceQuery.execute(MultiKeySliceQuery.java:51) at org.janusgraph.graphdb.database.IndexSerializer.query(IndexSerializer.java:512) at org.janusgraph.graphdb.util.SubqueryIterator.(SubqueryIterator.java:66) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1295) at org.janusgraph.graphdb.transaction.StandardJanusGraphTx$3.execute(StandardJanusGraphTx.java:1190) at org.janusgraph.graphdb.query.QueryProcessor$LimitAdjustingIterator.getNewIterator(QueryProcessor.java:194) at org.janusgraph.graphdb.query.LimitAdjustingIterator.hasNext(LimitAdjustingIterator.java:68) at org.janusgraph.graphdb.query.ResultSetIterator.nextInternal(ResultSetIterator.java:54) at org.janusgraph.graphdb.query.ResultSetIterator.(ResultSetIterator.java:44) at org.janusgraph.graphdb.query.QueryProcessor.iterator(QueryProcessor.java:66) at com.google.common.collect.Iterables$4.iterator(Iterables.java:559) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:84) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:55:20.905Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=78bd5c24-7d89-4ddc-afe6-ca749d51f75f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:20.905Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=78bd5c24-7d89-4ddc-afe6-ca749d51f75f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:21.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6456e853-8ebf-4ba8-8f0a-f5191873e8f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:21.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6456e853-8ebf-4ba8-8f0a-f5191873e8f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44719ecb 2021-04-14T11:55:21.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6456e853-8ebf-4ba8-8f0a-f5191873e8f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:21.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6456e853-8ebf-4ba8-8f0a-f5191873e8f1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:21.191Z [ApplicationDataTypeCacheThread-1] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServiceName=ReplaceDataTypesCache TargetServiceName=null ErrorCode=200 TargetEntity=FetchDataTypes Internal Connection problem. Description: Failed to fetch data types from graph(cache) 2021-04-14T11:55:21.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbb902d-a6eb-4e06-856f-5ce565a80f37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:21.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbb902d-a6eb-4e06-856f-5ce565a80f37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b34568b 2021-04-14T11:55:21.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbb902d-a6eb-4e06-856f-5ce565a80f37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:21.617Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fbb902d-a6eb-4e06-856f-5ce565a80f37 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:21.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52403031-55e2-4342-b0a0-d2d5ec734f1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:21.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52403031-55e2-4342-b0a0-d2d5ec734f1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5303e4de 2021-04-14T11:55:21.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52403031-55e2-4342-b0a0-d2d5ec734f1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:21.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52403031-55e2-4342-b0a0-d2d5ec734f1d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:22.430Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:55:22.431Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 4000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:55:22.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58b17ba-cd57-44b5-991d-116a544d468d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:22.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58b17ba-cd57-44b5-991d-116a544d468d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b4cbfb3 2021-04-14T11:55:22.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58b17ba-cd57-44b5-991d-116a544d468d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:22.446Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d58b17ba-cd57-44b5-991d-116a544d468d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:23.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275ca91c-e907-4134-ab8c-df832d186293 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:23.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275ca91c-e907-4134-ab8c-df832d186293 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bb712bc 2021-04-14T11:55:23.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275ca91c-e907-4134-ab8c-df832d186293 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:23.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=275ca91c-e907-4134-ab8c-df832d186293 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:23.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4a7723-c234-4af4-ae2d-873905727cce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:23.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4a7723-c234-4af4-ae2d-873905727cce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@523e874f 2021-04-14T11:55:23.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4a7723-c234-4af4-ae2d-873905727cce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:23.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d4a7723-c234-4af4-ae2d-873905727cce PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:24.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=014710c9-7f08-44b5-979a-79f070b03d27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:24.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=014710c9-7f08-44b5-979a-79f070b03d27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ed7acc2 2021-04-14T11:55:24.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=014710c9-7f08-44b5-979a-79f070b03d27 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:24.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=014710c9-7f08-44b5-979a-79f070b03d27 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:24.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:25.967Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:55:27.731Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=014710c9-7f08-44b5-979a-79f070b03d27 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:27.732Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=014710c9-7f08-44b5-979a-79f070b03d27 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:27.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:28.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2f85519-d3a9-49b4-865c-a4e9a249c722 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:28.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2f85519-d3a9-49b4-865c-a4e9a249c722 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6018398c 2021-04-14T11:55:28.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2f85519-d3a9-49b4-865c-a4e9a249c722 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:28.489Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2f85519-d3a9-49b4-865c-a4e9a249c722 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:29.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d511d740-c6c9-4ce5-a604-726e5967d833 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:29.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d511d740-c6c9-4ce5-a604-726e5967d833 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@257b1e1a 2021-04-14T11:55:29.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d511d740-c6c9-4ce5-a604-726e5967d833 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:29.055Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d511d740-c6c9-4ce5-a604-726e5967d833 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:29.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85ac7ed-b818-4dcf-aee3-c6852235160e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:29.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85ac7ed-b818-4dcf-aee3-c6852235160e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66917cb 2021-04-14T11:55:29.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85ac7ed-b818-4dcf-aee3-c6852235160e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:29.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e85ac7ed-b818-4dcf-aee3-c6852235160e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:30.813Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:32.717Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e85ac7ed-b818-4dcf-aee3-c6852235160e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:32.717Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e85ac7ed-b818-4dcf-aee3-c6852235160e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:33.062Z [JanusGraph-Health-Check-Thread] INFO o.j.d.util.BackendOperation Temporary exception during backend operation [EdgeStoreQuery]. Attempting backoff retry. org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$0(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.keycolumnvalue.KCVSProxy.getSlice(KCVSProxy.java:77) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:272) at org.janusgraph.diskstorage.BackendTransaction$1.call(BackendTransaction.java:269) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:68) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:54) at org.janusgraph.diskstorage.BackendTransaction.executeRead(BackendTransaction.java:470) at org.janusgraph.diskstorage.BackendTransaction.edgeStoreQuery(BackendTransaction.java:269) at org.janusgraph.graphdb.database.StandardJanusGraph.edgeQuery(StandardJanusGraph.java:436) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$null$0(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:98) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:90) at org.janusgraph.graphdb.query.profile.QueryProfiler.profile(QueryProfiler.java:82) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.lambda$getBasicIterator$1(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.vertices.CacheVertex.loadRelations(CacheVertex.java:67) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.getBasicIterator(SimpleVertexQueryProcessor.java:120) at org.janusgraph.graphdb.query.vertex.SimpleVertexQueryProcessor.iterator(SimpleVertexQueryProcessor.java:77) at org.janusgraph.graphdb.transaction.RelationConstructor$1.(RelationConstructor.java:47) at org.janusgraph.graphdb.transaction.RelationConstructor.lambda$readRelation$0(RelationConstructor.java:45) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.execute(VertexCentricQueryBuilder.java:73) at org.janusgraph.graphdb.query.vertex.VertexCentricQueryBuilder.properties(VertexCentricQueryBuilder.java:100) at org.janusgraph.graphdb.vertices.AbstractVertex.properties(AbstractVertex.java:177) at org.apache.tinkerpop.gremlin.structure.Vertex.property(Vertex.java:70) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:85) at org.openecomp.sdc.be.dao.janusgraph.JanusGraphClient$HealthCheckTask.call(JanusGraphClient.java:80) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:566) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:547) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:645) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:90) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:65) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 24 common frames omitted 2021-04-14T11:55:33.063Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-04-14T11:55:33.063Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 8000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:55:33.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5b97894-5b3e-4c79-a3ae-eed1ab9c7117 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:33.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5b97894-5b3e-4c79-a3ae-eed1ab9c7117 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@271c8ad3 2021-04-14T11:55:33.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5b97894-5b3e-4c79-a3ae-eed1ab9c7117 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:33.419Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5b97894-5b3e-4c79-a3ae-eed1ab9c7117 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:33.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7631bc-620b-4982-9007-b7bd4c9ee20c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7631bc-620b-4982-9007-b7bd4c9ee20c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16d14cbc 2021-04-14T11:55:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7631bc-620b-4982-9007-b7bd4c9ee20c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:34.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7631bc-620b-4982-9007-b7bd4c9ee20c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:34.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cedc1fcd-f5bf-48af-8ba8-350919b0a0f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:34.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cedc1fcd-f5bf-48af-8ba8-350919b0a0f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58c8d6e2 2021-04-14T11:55:34.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cedc1fcd-f5bf-48af-8ba8-350919b0a0f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:34.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cedc1fcd-f5bf-48af-8ba8-350919b0a0f8 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:35.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce84c07e-8a80-4419-8528-fa70fb3c9bb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:35.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce84c07e-8a80-4419-8528-fa70fb3c9bb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b41953a 2021-04-14T11:55:35.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce84c07e-8a80-4419-8528-fa70fb3c9bb6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:35.688Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce84c07e-8a80-4419-8528-fa70fb3c9bb6 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:35.982Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:55:36.243Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9141a571-9b77-4aed-a566-b004cb707990 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:55:36.242897Z InvocationID=b202e624-e9d0-4504-b1c4-d77f2be72e0f LogTimestamp=2021-04-14T11:55:36.242962Z Entering 2021-04-14T11:55:36.243Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9141a571-9b77-4aed-a566-b004cb707990 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:55:36.242897Z InvocationID=b202e624-e9d0-4504-b1c4-d77f2be72e0f LogTimestamp=2021-04-14T11:55:36.242962Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:55:36.245Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:55:36.243Z InvocationID=cce250a6-6d25-4bae-9f01-5e0962f03a8b LogTimestamp=2021-04-14T11:55:36.245437Z ResponseDesc=OK Exiting. 2021-04-14T11:55:36.245Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:55:36.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8df3bf9a-d835-4c02-9982-eb494ad4945d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:36.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8df3bf9a-d835-4c02-9982-eb494ad4945d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@489565ba 2021-04-14T11:55:36.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8df3bf9a-d835-4c02-9982-eb494ad4945d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:36.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8df3bf9a-d835-4c02-9982-eb494ad4945d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:37.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf9c280-eee9-4015-b22b-898357a97caf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:37.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf9c280-eee9-4015-b22b-898357a97caf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54bd64b8 2021-04-14T11:55:37.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf9c280-eee9-4015-b22b-898357a97caf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:37.390Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0bf9c280-eee9-4015-b22b-898357a97caf PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:40.393Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0bf9c280-eee9-4015-b22b-898357a97caf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:40.393Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0bf9c280-eee9-4015-b22b-898357a97caf ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:40.393Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0bf9c280-eee9-4015-b22b-898357a97caf ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:40.393Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=0bf9c280-eee9-4015-b22b-898357a97caf ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:40.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043cd251-22b9-4bc2-86ff-93bf10ba2bce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:40.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043cd251-22b9-4bc2-86ff-93bf10ba2bce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a5cd70b 2021-04-14T11:55:40.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043cd251-22b9-4bc2-86ff-93bf10ba2bce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:40.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043cd251-22b9-4bc2-86ff-93bf10ba2bce PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:41.284Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE 2021-04-14T11:55:41.285Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 16000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:55:41.511Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5a5e8cf-e394-4b79-809e-1f74fcbebfaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:41.511Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5a5e8cf-e394-4b79-809e-1f74fcbebfaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e787584 2021-04-14T11:55:41.511Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5a5e8cf-e394-4b79-809e-1f74fcbebfaf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:41.511Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5a5e8cf-e394-4b79-809e-1f74fcbebfaf PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:41.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154f3dec-ff50-40fc-87f8-d367be53425d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:41.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154f3dec-ff50-40fc-87f8-d367be53425d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15f5e57 2021-04-14T11:55:41.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154f3dec-ff50-40fc-87f8-d367be53425d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:41.741Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=154f3dec-ff50-40fc-87f8-d367be53425d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e66bb80-d23b-4994-b481-bcb7f9fddc9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e66bb80-d23b-4994-b481-bcb7f9fddc9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d9735f8 2021-04-14T11:55:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e66bb80-d23b-4994-b481-bcb7f9fddc9d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:41.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e66bb80-d23b-4994-b481-bcb7f9fddc9d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:42.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb22452-ddbf-4dbe-a81d-6e8d99210bc1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:42.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb22452-ddbf-4dbe-a81d-6e8d99210bc1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6beb11ee 2021-04-14T11:55:42.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb22452-ddbf-4dbe-a81d-6e8d99210bc1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:42.167Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb22452-ddbf-4dbe-a81d-6e8d99210bc1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:42.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=985ea5ea-93e5-4738-86eb-377865827c8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:42.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=985ea5ea-93e5-4738-86eb-377865827c8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16428d42 2021-04-14T11:55:42.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=985ea5ea-93e5-4738-86eb-377865827c8c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:42.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=985ea5ea-93e5-4738-86eb-377865827c8c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:43.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc764c8e-b387-4d28-9593-cedc9dd06f0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:43.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc764c8e-b387-4d28-9593-cedc9dd06f0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d14d43b 2021-04-14T11:55:43.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc764c8e-b387-4d28-9593-cedc9dd06f0a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:43.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc764c8e-b387-4d28-9593-cedc9dd06f0a PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:44.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228b22ec-ebbf-41c4-9b78-2e93e5711434 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:44.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228b22ec-ebbf-41c4-9b78-2e93e5711434 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79b81494 2021-04-14T11:55:44.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228b22ec-ebbf-41c4-9b78-2e93e5711434 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:44.329Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=228b22ec-ebbf-41c4-9b78-2e93e5711434 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:55:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:55:47.333Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=228b22ec-ebbf-41c4-9b78-2e93e5711434 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:47.333Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=228b22ec-ebbf-41c4-9b78-2e93e5711434 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:48.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aecfc866-f4fc-4a71-a687-014e01b7ff0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:48.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aecfc866-f4fc-4a71-a687-014e01b7ff0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a6f0e2c 2021-04-14T11:55:48.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aecfc866-f4fc-4a71-a687-014e01b7ff0d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:48.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aecfc866-f4fc-4a71-a687-014e01b7ff0d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:48.219Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1d536195-85ef-445e-af20-9abec96b1855 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:55:48.219329Z InvocationID=ff39683b-0d74-486a-9c87-216b537cea00 LogTimestamp=2021-04-14T11:55:48.219376Z Entering 2021-04-14T11:55:48.219Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1d536195-85ef-445e-af20-9abec96b1855 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:55:48.219329Z InvocationID=ff39683b-0d74-486a-9c87-216b537cea00 LogTimestamp=2021-04-14T11:55:48.219376Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:55:48.220Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:55:48.219Z InvocationID=d85d2984-b4ec-46a1-959d-047189c60f77 LogTimestamp=2021-04-14T11:55:48.220679Z ResponseDesc=OK Exiting. 2021-04-14T11:55:48.220Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:55:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:48.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:55:50.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:50.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bb1291 2021-04-14T11:55:50.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:50.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:50.824Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:55:53.133Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:53.134Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:53.134Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:53.134Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3de3deea-f349-4ff0-8b8e-6e1ae606fb26 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:55:53.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:53.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a9ebac6 2021-04-14T11:55:53.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:53.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:55:54.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:55:56.416Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:55:56.417Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:55:56.417Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:56.417Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=01a23802-df9a-45c9-ab79-af814dfbf07d ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0688859-3a2d-4826-ae50-0eb195405ac0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:56.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0688859-3a2d-4826-ae50-0eb195405ac0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d07de3d 2021-04-14T11:55:56.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0688859-3a2d-4826-ae50-0eb195405ac0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:56.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0688859-3a2d-4826-ae50-0eb195405ac0 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:57.220Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=a0688859-3a2d-4826-ae50-0eb195405ac0 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:57.220Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=a0688859-3a2d-4826-ae50-0eb195405ac0 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:55:57.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da747b82-6fe1-47b0-acf0-28a085249e22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:57.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da747b82-6fe1-47b0-acf0-28a085249e22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7974b204 2021-04-14T11:55:57.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da747b82-6fe1-47b0-acf0-28a085249e22 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:57.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da747b82-6fe1-47b0-acf0-28a085249e22 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:58.235Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE 2021-04-14T11:55:58.236Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 32000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:55:58.292Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:55:58.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efe9605-d733-4bf0-952b-efbc48613389 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:58.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efe9605-d733-4bf0-952b-efbc48613389 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67360488 2021-04-14T11:55:58.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efe9605-d733-4bf0-952b-efbc48613389 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:58.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9efe9605-d733-4bf0-952b-efbc48613389 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:59.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7b357c-93ac-49b1-8cf5-ae2ad09d3e54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:59.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7b357c-93ac-49b1-8cf5-ae2ad09d3e54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3413c865 2021-04-14T11:55:59.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7b357c-93ac-49b1-8cf5-ae2ad09d3e54 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:59.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7b357c-93ac-49b1-8cf5-ae2ad09d3e54 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:55:59.640Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8b7b357c-93ac-49b1-8cf5-ae2ad09d3e54 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:59.640Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=8b7b357c-93ac-49b1-8cf5-ae2ad09d3e54 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:55:59.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb749cd-effb-49e9-a096-2eabb501dfeb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:55:59.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb749cd-effb-49e9-a096-2eabb501dfeb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19f95fb7 2021-04-14T11:55:59.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb749cd-effb-49e9-a096-2eabb501dfeb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:55:59.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbb749cd-effb-49e9-a096-2eabb501dfeb PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:00.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4925991-adf0-40c6-a3ea-7ac6a1ef318d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:00.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4925991-adf0-40c6-a3ea-7ac6a1ef318d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45412a1e 2021-04-14T11:56:00.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4925991-adf0-40c6-a3ea-7ac6a1ef318d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:00.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4925991-adf0-40c6-a3ea-7ac6a1ef318d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:00.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7636715f-6a57-4ac5-8f5c-b852bb59c380 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:00.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7636715f-6a57-4ac5-8f5c-b852bb59c380 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1284747a 2021-04-14T11:56:00.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7636715f-6a57-4ac5-8f5c-b852bb59c380 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:00.255Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7636715f-6a57-4ac5-8f5c-b852bb59c380 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3deb2ee-1e2b-4134-bd48-825154f9c8a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3deb2ee-1e2b-4134-bd48-825154f9c8a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38fed6af 2021-04-14T11:56:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3deb2ee-1e2b-4134-bd48-825154f9c8a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3deb2ee-1e2b-4134-bd48-825154f9c8a1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:56:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:56:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:56:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:56:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:56:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:56:06.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4313f580-0315-44ef-a159-1f55b50ce63e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:06.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4313f580-0315-44ef-a159-1f55b50ce63e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b2922e0 2021-04-14T11:56:06.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4313f580-0315-44ef-a159-1f55b50ce63e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:06.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4313f580-0315-44ef-a159-1f55b50ce63e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:06.244Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9425d21d-5ce8-4f78-80c7-f22fed39f36b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:56:06.243733Z InvocationID=5ddd2a46-8d67-4972-a926-c8ebf2b89de3 LogTimestamp=2021-04-14T11:56:06.243789Z Entering 2021-04-14T11:56:06.244Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9425d21d-5ce8-4f78-80c7-f22fed39f36b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:56:06.243733Z InvocationID=5ddd2a46-8d67-4972-a926-c8ebf2b89de3 LogTimestamp=2021-04-14T11:56:06.243789Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:56:06.246Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:56:06.244Z InvocationID=f3a2f4d5-c8af-4e00-93dc-28b20b957554 LogTimestamp=2021-04-14T11:56:06.246416Z ResponseDesc=OK Exiting. 2021-04-14T11:56:06.246Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:56:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:56:06.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:56:09.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2774e441 2021-04-14T11:56:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:12.091Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:56:12.092Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:56:12.092Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:56:12.092Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=fdf97dbd-a7d9-4e12-8771-7ea18469fb73 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:56:12.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9839584d-45f4-47a9-8669-941ad0a28f70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:12.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9839584d-45f4-47a9-8669-941ad0a28f70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16e26371 2021-04-14T11:56:12.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9839584d-45f4-47a9-8669-941ad0a28f70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:12.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9839584d-45f4-47a9-8669-941ad0a28f70 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:13.338Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:56:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7afb9372 2021-04-14T11:56:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:17.701Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:56:17.703Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:56:17.703Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:56:17.703Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=cd2cb248-65e6-4cfa-b5f1-f9559a007fe9 ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:56:18.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79be18de-66bc-49d7-b124-6c6d3df3c45a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:18.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79be18de-66bc-49d7-b124-6c6d3df3c45a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a2d3680 2021-04-14T11:56:18.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79be18de-66bc-49d7-b124-6c6d3df3c45a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:18.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79be18de-66bc-49d7-b124-6c6d3df3c45a PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb40f0ea-5a7d-4429-b1c6-ef9c09cf9c8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb40f0ea-5a7d-4429-b1c6-ef9c09cf9c8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bf782ed 2021-04-14T11:56:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb40f0ea-5a7d-4429-b1c6-ef9c09cf9c8e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb40f0ea-5a7d-4429-b1c6-ef9c09cf9c8e PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:56:21.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:56:23.557Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=fb40f0ea-5a7d-4429-b1c6-ef9c09cf9c8e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:56:23.557Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=fb40f0ea-5a7d-4429-b1c6-ef9c09cf9c8e ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:56:23.919Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:56:24.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc7c112-0f89-48b9-bad1-1175d77a3176 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:24.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc7c112-0f89-48b9-bad1-1175d77a3176 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3db1e2e2 2021-04-14T11:56:24.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc7c112-0f89-48b9-bad1-1175d77a3176 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:24.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc7c112-0f89-48b9-bad1-1175d77a3176 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:25.168Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=3bc7c112-0f89-48b9-bad1-1175d77a3176 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:56:25.168Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=3bc7c112-0f89-48b9-bad1-1175d77a3176 ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:56:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd53858-38e1-4576-82d4-3d1e1e81e0dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd53858-38e1-4576-82d4-3d1e1e81e0dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@584697a9 2021-04-14T11:56:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd53858-38e1-4576-82d4-3d1e1e81e0dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:27.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1fd53858-38e1-4576-82d4-3d1e1e81e0dc PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:29.642Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1fd53858-38e1-4576-82d4-3d1e1e81e0dc ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:56:29.642Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=1fd53858-38e1-4576-82d4-3d1e1e81e0dc ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:56:30.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6289b7d-cf60-48d0-a988-28f5bce20024 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:30.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6289b7d-cf60-48d0-a988-28f5bce20024 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f0196a6 2021-04-14T11:56:30.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6289b7d-cf60-48d0-a988-28f5bce20024 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:30.322Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6289b7d-cf60-48d0-a988-28f5bce20024 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:30.331Z [cluster1-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE 2021-04-14T11:56:30.331Z [cluster1-reconnection-0] ERROR com.datastax.driver.core.Cluster Authentication error during reconnection to cassandra.onap/10.242.70.81:9042, scheduling retry in 64000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra.onap/10.242.70.81:9042: Error during authentication of user asdc_user : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE at com.datastax.driver.core.Connection$9.apply(Connection.java:518) at com.datastax.driver.core.Connection$9.apply(Connection.java:480) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213) at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202) at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118) at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1213) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:983) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:746) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1509) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1262) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1180) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:475) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.base/java.lang.Thread.run(Unknown Source) 2021-04-14T11:56:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:33.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16c1ee8-112a-4c30-81de-66ba838ea0fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:33.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16c1ee8-112a-4c30-81de-66ba838ea0fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d15dd56 2021-04-14T11:56:33.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16c1ee8-112a-4c30-81de-66ba838ea0fb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:33.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16c1ee8-112a-4c30-81de-66ba838ea0fb PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65d0231-2e14-4e40-8386-670125ea8d98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65d0231-2e14-4e40-8386-670125ea8d98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@398de24c 2021-04-14T11:56:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65d0231-2e14-4e40-8386-670125ea8d98 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a65d0231-2e14-4e40-8386-670125ea8d98 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:36.242Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c4ee5bc1-bb47-4890-aa0c-3ecd64e52566 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:56:36.242093Z InvocationID=fec84bfb-8b81-4325-bc2e-49ece53a2bc4 LogTimestamp=2021-04-14T11:56:36.242242Z Entering 2021-04-14T11:56:36.243Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c4ee5bc1-bb47-4890-aa0c-3ecd64e52566 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:56:36.242093Z InvocationID=fec84bfb-8b81-4325-bc2e-49ece53a2bc4 LogTimestamp=2021-04-14T11:56:36.242242Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:56:36.246Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:56:36.243Z InvocationID=2d68a06e-f64b-4b07-9689-a79dcefa046e LogTimestamp=2021-04-14T11:56:36.246332Z ResponseDesc=OK Exiting. 2021-04-14T11:56:36.246Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:56:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:56:36.812Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:56:38.835Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:56:38.904Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=a65d0231-2e14-4e40-8386-670125ea8d98 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:56:38.905Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=a65d0231-2e14-4e40-8386-670125ea8d98 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:56:39.071Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501b864e-9b31-4397-9475-ef4a97f833df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:39.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501b864e-9b31-4397-9475-ef4a97f833df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@551ad10b 2021-04-14T11:56:39.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501b864e-9b31-4397-9475-ef4a97f833df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:39.072Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=501b864e-9b31-4397-9475-ef4a97f833df PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d912282-94d7-43a5-98f7-a10bae22db00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d912282-94d7-43a5-98f7-a10bae22db00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45414f58 2021-04-14T11:56:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d912282-94d7-43a5-98f7-a10bae22db00 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5d912282-94d7-43a5-98f7-a10bae22db00 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:44.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f4a071-2077-4c2e-884a-d596a8d99fb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:44.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f4a071-2077-4c2e-884a-d596a8d99fb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13084a3e 2021-04-14T11:56:44.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f4a071-2077-4c2e-884a-d596a8d99fb7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:44.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33f4a071-2077-4c2e-884a-d596a8d99fb7 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:56:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:56:47.830Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=33f4a071-2077-4c2e-884a-d596a8d99fb7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:56:47.830Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=33f4a071-2077-4c2e-884a-d596a8d99fb7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:56:48.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cacf7f4-27eb-4693-8686-ccb3d84665bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:48.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cacf7f4-27eb-4693-8686-ccb3d84665bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@109953dd 2021-04-14T11:56:48.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cacf7f4-27eb-4693-8686-ccb3d84665bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:48.508Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cacf7f4-27eb-4693-8686-ccb3d84665bb PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b74cd8-9fd6-44cc-8949-55f94e5babb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b74cd8-9fd6-44cc-8949-55f94e5babb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1735f730 2021-04-14T11:56:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b74cd8-9fd6-44cc-8949-55f94e5babb7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b74cd8-9fd6-44cc-8949-55f94e5babb7 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:53.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b33fb326-318c-471d-92c5-f9d1e1b131ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:53.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b33fb326-318c-471d-92c5-f9d1e1b131ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@463d1652 2021-04-14T11:56:53.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b33fb326-318c-471d-92c5-f9d1e1b131ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:53.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b33fb326-318c-471d-92c5-f9d1e1b131ce PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:57.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db47a10e-9fbe-4650-bce9-428ebdcedfdf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:57.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db47a10e-9fbe-4650-bce9-428ebdcedfdf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ce0a2f3 2021-04-14T11:56:57.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db47a10e-9fbe-4650-bce9-428ebdcedfdf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:57.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db47a10e-9fbe-4650-bce9-428ebdcedfdf PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:56:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=884d92e7-9184-48e8-9509-c65cc4742ff3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:56:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=884d92e7-9184-48e8-9509-c65cc4742ff3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e341730 2021-04-14T11:56:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=884d92e7-9184-48e8-9509-c65cc4742ff3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:56:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=884d92e7-9184-48e8-9509-c65cc4742ff3 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223ce582-d276-4792-97f4-cc1a25f52f81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223ce582-d276-4792-97f4-cc1a25f52f81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7600e5b1 2021-04-14T11:57:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223ce582-d276-4792-97f4-cc1a25f52f81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223ce582-d276-4792-97f4-cc1a25f52f81 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:57:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:57:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:57:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:57:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:57:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:57:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88247b8-2059-4236-a580-b99b79f4bfaa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88247b8-2059-4236-a580-b99b79f4bfaa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5821f2a5 2021-04-14T11:57:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88247b8-2059-4236-a580-b99b79f4bfaa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d88247b8-2059-4236-a580-b99b79f4bfaa PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:06.253Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ed137135-713b-41d5-92f2-8471a666f5ca InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:06.253695Z InvocationID=78cf71ed-aeab-4d8f-aba6-b28eb4367ffe LogTimestamp=2021-04-14T11:57:06.253765Z Entering 2021-04-14T11:57:06.254Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ed137135-713b-41d5-92f2-8471a666f5ca InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:06.253695Z InvocationID=78cf71ed-aeab-4d8f-aba6-b28eb4367ffe LogTimestamp=2021-04-14T11:57:06.253765Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:57:06.255Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:57:06.254Z InvocationID=bbe1f70f-c414-476b-961e-6f4f194663c8 LogTimestamp=2021-04-14T11:57:06.255664Z ResponseDesc=OK Exiting. 2021-04-14T11:57:06.255Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:57:09.089Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d88247b8-2059-4236-a580-b99b79f4bfaa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:57:09.089Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d88247b8-2059-4236-a580-b99b79f4bfaa ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:57:09.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8826ab-dff0-4c6c-ab37-a316502e26b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:09.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8826ab-dff0-4c6c-ab37-a316502e26b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@414f3468 2021-04-14T11:57:09.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8826ab-dff0-4c6c-ab37-a316502e26b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:09.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e8826ab-dff0-4c6c-ab37-a316502e26b9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:12.644Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:57:12.645Z [JanusGraph-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend probably lost connectivity to JanusGraph DB. Please check the logs for more information. 2021-04-14T11:57:13.019Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=7e8826ab-dff0-4c6c-ab37-a316502e26b9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:57:13.020Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=7e8826ab-dff0-4c6c-ab37-a316502e26b9 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:57:13.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16cedd2-f059-40dd-85d8-437a4be080fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:13.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16cedd2-f059-40dd-85d8-437a4be080fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ef073df 2021-04-14T11:57:13.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16cedd2-f059-40dd-85d8-437a4be080fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:13.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16cedd2-f059-40dd-85d8-437a4be080fe PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:13.645Z [JanusGraph-Health-Check-Task] ERROR o.o.s.b.d.j.JanusGraphClient RequestID=null ErrorCategory=ERROR ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck JanusGraph Health Check Failed. java.util.concurrent.TimeoutException 2021-04-14T11:57:15.151Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=f16cedd2-f059-40dd-85d8-437a4be080fe ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:57:15.151Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=CRITICAL RequestID=f16cedd2-f059-40dd-85d8-437a4be080fe ErrorCategory=ERROR ServiceName=BE Component JANUSGRAPH state changed from UP to DOWN TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend probably lost connectivity to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. Please check the logs for more information. 2021-04-14T11:57:15.392Z [JanusGraph-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=null ErrorCategory=INFO ServerIPAddress=10.242.62.146 ServiceName=janusgraphHealthCheck TargetServiceName=null ErrorCode=200 ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m TargetEntity=janusgraphHealthCheck ASDC Backend connection recovery to JanusGraph DB. 2021-04-14T11:57:15.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24147329-63c9-4db8-9501-bd25ed174be9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:15.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24147329-63c9-4db8-9501-bd25ed174be9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31478f40 2021-04-14T11:57:15.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24147329-63c9-4db8-9501-bd25ed174be9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:15.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24147329-63c9-4db8-9501-bd25ed174be9 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:16.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:16.206Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:16.207Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:16.208Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:17.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=987f5da8-4a9d-4343-967f-f5069d7a97b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=987f5da8-4a9d-4343-967f-f5069d7a97b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f921488 2021-04-14T11:57:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=987f5da8-4a9d-4343-967f-f5069d7a97b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=987f5da8-4a9d-4343-967f-f5069d7a97b6 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:18.538Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=987f5da8-4a9d-4343-967f-f5069d7a97b6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component JANUSGRAPH state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:57:18.538Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=987f5da8-4a9d-4343-967f-f5069d7a97b6 ErrorCategory=INFO ServiceName=BE Component JANUSGRAPH state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:57:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8f44482-f4a5-431e-820a-691859926bdd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8f44482-f4a5-431e-820a-691859926bdd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22a1fe2e 2021-04-14T11:57:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8f44482-f4a5-431e-820a-691859926bdd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8f44482-f4a5-431e-820a-691859926bdd PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:21.325Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=d8f44482-f4a5-431e-820a-691859926bdd PartnerName=SDC.BE I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {s}->https://sdc-onboarding-be.onap:8445: The target server failed to respond 2021-04-14T11:57:21.325Z [BE-Health-Check-Task] INFO o.a.http.impl.execchain.RetryExec RequestID=d8f44482-f4a5-431e-820a-691859926bdd PartnerName=SDC.BE Retrying request to {s}->https://sdc-onboarding-be.onap:8445 2021-04-14T11:57:21.329Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=d8f44482-f4a5-431e-820a-691859926bdd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) 2021-04-14T11:57:21.329Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=d8f44482-f4a5-431e-820a-691859926bdd ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.base/java.net.SocksSocketImpl.connect(Unknown Source) at java.base/java.net.Socket.connect(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:21.329Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d8f44482-f4a5-431e-820a-691859926bdd ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from UP to DOWN ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:57:21.329Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=d8f44482-f4a5-431e-820a-691859926bdd ErrorCategory=INFO ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:57:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615dbd45-4908-445d-9c7b-5b76a3039da0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615dbd45-4908-445d-9c7b-5b76a3039da0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ea0984f 2021-04-14T11:57:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615dbd45-4908-445d-9c7b-5b76a3039da0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:24.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615dbd45-4908-445d-9c7b-5b76a3039da0 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:24.122Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=615dbd45-4908-445d-9c7b-5b76a3039da0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) 2021-04-14T11:57:24.123Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=615dbd45-4908-445d-9c7b-5b76a3039da0 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.base/java.net.SocksSocketImpl.connect(Unknown Source) at java.base/java.net.Socket.connect(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:26.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b023020-2131-42fe-b318-00bc9a789b7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:26.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b023020-2131-42fe-b318-00bc9a789b7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c0439c8 2021-04-14T11:57:26.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b023020-2131-42fe-b318-00bc9a789b7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:26.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b023020-2131-42fe-b318-00bc9a789b7a PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:26.999Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=0b023020-2131-42fe-b318-00bc9a789b7a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) 2021-04-14T11:57:26.999Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=0b023020-2131-42fe-b318-00bc9a789b7a ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.HttpHostConnectException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.base/java.net.SocksSocketImpl.connect(Unknown Source) at java.base/java.net.Socket.connect(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:29.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e36517-99e3-4408-87eb-0ad2fcfeb99c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:29.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e36517-99e3-4408-87eb-0ad2fcfeb99c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7419e661 2021-04-14T11:57:29.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e36517-99e3-4408-87eb-0ad2fcfeb99c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:29.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5e36517-99e3-4408-87eb-0ad2fcfeb99c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:32.740Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=e5e36517-99e3-4408-87eb-0ad2fcfeb99c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:57:32.740Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=e5e36517-99e3-4408-87eb-0ad2fcfeb99c ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cafcbe1a-cc82-48b9-9a74-fd4ec58597ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cafcbe1a-cc82-48b9-9a74-fd4ec58597ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37830083 2021-04-14T11:57:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cafcbe1a-cc82-48b9-9a74-fd4ec58597ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cafcbe1a-cc82-48b9-9a74-fd4ec58597ad PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:36.244Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b8368271-06bf-4c06-bf54-31414bc2c65d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:36.244047Z InvocationID=d302d47f-febb-42d2-9595-c0645f0954fd LogTimestamp=2021-04-14T11:57:36.244119Z Entering 2021-04-14T11:57:36.244Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b8368271-06bf-4c06-bf54-31414bc2c65d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:36.244047Z InvocationID=d302d47f-febb-42d2-9595-c0645f0954fd LogTimestamp=2021-04-14T11:57:36.244119Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:57:36.246Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:57:36.244Z InvocationID=987bbad5-5d8d-4b6e-99b2-1a72502a248a LogTimestamp=2021-04-14T11:57:36.246279Z ResponseDesc=OK Exiting. 2021-04-14T11:57:36.246Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:57:36.435Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=cafcbe1a-cc82-48b9-9a74-fd4ec58597ad ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:57:36.435Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=cafcbe1a-cc82-48b9-9a74-fd4ec58597ad ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:36.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe07119-f8f5-4fd3-b549-d4c9a77797c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:36.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe07119-f8f5-4fd3-b549-d4c9a77797c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@497eb8fa 2021-04-14T11:57:36.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe07119-f8f5-4fd3-b549-d4c9a77797c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:36.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe07119-f8f5-4fd3-b549-d4c9a77797c7 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:40.002Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=ebe07119-f8f5-4fd3-b549-d4c9a77797c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:57:40.002Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=ebe07119-f8f5-4fd3-b549-d4c9a77797c7 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:40.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a91d33e-c7b9-4b09-a95b-4bcb2e447e0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:40.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a91d33e-c7b9-4b09-a95b-4bcb2e447e0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29fee74a 2021-04-14T11:57:40.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a91d33e-c7b9-4b09-a95b-4bcb2e447e0f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:40.389Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a91d33e-c7b9-4b09-a95b-4bcb2e447e0f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:43.396Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3a91d33e-c7b9-4b09-a95b-4bcb2e447e0f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out 2021-04-14T11:57:43.397Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3a91d33e-c7b9-4b09-a95b-4bcb2e447e0f ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to sdc-onboarding-be.onap:8445 [sdc-onboarding-be.onap/10.96.123.134] failed: Read timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.decode(Unknown Source) at java.base/sun.security.ssl.SSLTransport.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.decode(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(Unknown Source) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:396) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 22 common frames omitted 2021-04-14T11:57:44.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3373a933-3d09-406e-ab39-a3acdfed71eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:44.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3373a933-3d09-406e-ab39-a3acdfed71eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c8cfbfc 2021-04-14T11:57:44.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3373a933-3d09-406e-ab39-a3acdfed71eb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:44.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3373a933-3d09-406e-ab39-a3acdfed71eb PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:57:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:57:47.203Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ed183e2d-441e-4331-821e-e2e08dfdafda InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.93 StatusCode=INPROGRESS RemoteHost=10.242.70.93 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:47.203332Z InvocationID=0bf5117a-b8da-4887-a550-5dbc7b1ff087 LogTimestamp=2021-04-14T11:57:47.203397Z Entering 2021-04-14T11:57:47.203Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ed183e2d-441e-4331-821e-e2e08dfdafda InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.70.93 StatusCode=INPROGRESS userId=null RemoteHost=10.242.70.93 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:47.203332Z InvocationID=0bf5117a-b8da-4887-a550-5dbc7b1ff087 LogTimestamp=2021-04-14T11:57:47.203397Z localAddr=10.242.62.146 remoteAddr=10.242.70.93 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:57:47.205Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:57:47.204Z InvocationID=7feff212-9a3f-4625-95f3-a669d07029e3 LogTimestamp=2021-04-14T11:57:47.205669Z ResponseDesc=OK Exiting. 2021-04-14T11:57:47.206Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:57:48.222Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fa79e538-6a36-4b4a-923b-70c527c02914 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:48.222474Z InvocationID=4a54d798-8498-40d9-94a5-ad122b99a362 LogTimestamp=2021-04-14T11:57:48.222513Z Entering 2021-04-14T11:57:48.222Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fa79e538-6a36-4b4a-923b-70c527c02914 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:57:48.222474Z InvocationID=4a54d798-8498-40d9-94a5-ad122b99a362 LogTimestamp=2021-04-14T11:57:48.222513Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:57:48.224Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:57:48.223Z InvocationID=0225e867-5da3-41e0-bae3-ee6427861eca LogTimestamp=2021-04-14T11:57:48.224101Z ResponseDesc=OK Exiting. 2021-04-14T11:57:48.224Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:57:49.529Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=3373a933-3d09-406e-ab39-a3acdfed71eb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:57:49.529Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=3373a933-3d09-406e-ab39-a3acdfed71eb ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:57:50.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cbc9e5-cea3-4472-a692-88c20bfb8543 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:50.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cbc9e5-cea3-4472-a692-88c20bfb8543 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7735288e 2021-04-14T11:57:50.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cbc9e5-cea3-4472-a692-88c20bfb8543 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:50.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6cbc9e5-cea3-4472-a692-88c20bfb8543 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:53.162Z [BE-Health-Check-Task] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=b6cbc9e5-cea3-4472-a692-88c20bfb8543 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=ExecuteRestRequest Internal flow error. Operation: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out 2021-04-14T11:57:53.162Z [BE-Health-Check-Task] ERROR o.o.s.b.c.h.HealthCheckBusinessLogic RequestID=b6cbc9e5-cea3-4472-a692-88c20bfb8543 ErrorCategory=ERROR ServiceName=ExecuteRestRequest TargetServiceName=null ErrorCode=500 PartnerName=SDC.BE TargetEntity=null ON_BOARDING unexpected response: org.openecomp.sdc.common.http.client.api.HttpExecuteException: Execute request GET https://sdc-onboarding-be.onap:8445/onboarding-api/v1.0/healthcheck HTTP/1.1 failed with exception: Read timed out at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:119) at org.openecomp.sdc.common.http.client.api.HttpClient.get(HttpClient.java:61) at org.openecomp.sdc.common.http.client.api.HttpRequestHandler.get(HttpRequestHandler.java:81) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:55) at org.openecomp.sdc.common.http.client.api.HttpRequest.get(HttpRequest.java:51) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getHostedComponentsBeHealthCheck(HealthCheckBusinessLogic.java:258) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic.getBeHealthCheckInfos(HealthCheckBusinessLogic.java:163) at org.openecomp.sdc.be.components.health.HealthCheckBusinessLogic$HealthCheckScheduledTask.run(HealthCheckBusinessLogic.java:446) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketTimeoutException: Read timed out at java.base/java.net.SocketInputStream.socketRead0(Native Method) at java.base/java.net.SocketInputStream.socketRead(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source) at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source) at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source) at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:139) at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:155) at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:284) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138) at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261) at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165) at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.openecomp.sdc.common.http.client.api.HttpClient.execute(HttpClient.java:111) ... 13 common frames omitted 2021-04-14T11:57:53.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7d8bcb-0fe0-4479-800c-4029924c5f24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:53.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7d8bcb-0fe0-4479-800c-4029924c5f24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@658ec1e2 2021-04-14T11:57:53.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7d8bcb-0fe0-4479-800c-4029924c5f24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:53.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b7d8bcb-0fe0-4479-800c-4029924c5f24 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:54.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f0ef3fd-6394-4162-a9fb-4b3fb3fa436f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:54.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f0ef3fd-6394-4162-a9fb-4b3fb3fa436f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@682fd1fd 2021-04-14T11:57:54.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f0ef3fd-6394-4162-a9fb-4b3fb3fa436f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:54.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f0ef3fd-6394-4162-a9fb-4b3fb3fa436f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:55.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=213d59f9-a170-4016-bb9b-5251fc227a14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:55.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=213d59f9-a170-4016-bb9b-5251fc227a14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42f52e2b 2021-04-14T11:57:55.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=213d59f9-a170-4016-bb9b-5251fc227a14 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:55.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=213d59f9-a170-4016-bb9b-5251fc227a14 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:56.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2189055f-dbd5-4b23-8c81-e3c91741b4e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:56.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2189055f-dbd5-4b23-8c81-e3c91741b4e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51677646 2021-04-14T11:57:56.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2189055f-dbd5-4b23-8c81-e3c91741b4e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:56.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2189055f-dbd5-4b23-8c81-e3c91741b4e4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:57:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ce93bf-e907-4052-ac3d-d217b9d80458 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:57:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ce93bf-e907-4052-ac3d-d217b9d80458 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60a12d27 2021-04-14T11:57:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ce93bf-e907-4052-ac3d-d217b9d80458 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:57:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68ce93bf-e907-4052-ac3d-d217b9d80458 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d30c05a-6bf7-4c50-8e11-f30e439f3882 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d30c05a-6bf7-4c50-8e11-f30e439f3882 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7617b8f7 2021-04-14T11:58:02.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d30c05a-6bf7-4c50-8e11-f30e439f3882 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:02.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d30c05a-6bf7-4c50-8e11-f30e439f3882 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:58:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:58:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:58:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:58:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:58:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:58:06.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f6a463-480d-4d20-b9ac-2caab2139873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:06.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f6a463-480d-4d20-b9ac-2caab2139873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d784468 2021-04-14T11:58:06.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f6a463-480d-4d20-b9ac-2caab2139873 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:06.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f6a463-480d-4d20-b9ac-2caab2139873 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:06.240Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=72738986-394e-4187-99fd-65bde2aab44a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:58:06.239990Z InvocationID=4da96821-d9be-46c7-958e-b532c3f338c3 LogTimestamp=2021-04-14T11:58:06.240066Z Entering 2021-04-14T11:58:06.240Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=72738986-394e-4187-99fd-65bde2aab44a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:58:06.239990Z InvocationID=4da96821-d9be-46c7-958e-b532c3f338c3 LogTimestamp=2021-04-14T11:58:06.240066Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:58:06.244Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:58:06.241Z InvocationID=4f9d270c-4264-402a-bf65-72b934e97cde LogTimestamp=2021-04-14T11:58:06.243878Z ResponseDesc=OK Exiting. 2021-04-14T11:58:06.244Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:58:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf4a6ea1-8f09-476d-b87b-0bdb0d7fc41d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf4a6ea1-8f09-476d-b87b-0bdb0d7fc41d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77c7c4c7 2021-04-14T11:58:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf4a6ea1-8f09-476d-b87b-0bdb0d7fc41d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf4a6ea1-8f09-476d-b87b-0bdb0d7fc41d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:12.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a520e9b-18ee-4d90-9392-97db7ef52719 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:12.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a520e9b-18ee-4d90-9392-97db7ef52719 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e66070d 2021-04-14T11:58:12.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a520e9b-18ee-4d90-9392-97db7ef52719 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:12.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a520e9b-18ee-4d90-9392-97db7ef52719 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:14.706Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b86487b-037f-404d-aa68-724c7e1a8a87 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:14.707Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b86487b-037f-404d-aa68-724c7e1a8a87 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@557dc436 2021-04-14T11:58:14.707Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b86487b-037f-404d-aa68-724c7e1a8a87 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:14.707Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b86487b-037f-404d-aa68-724c7e1a8a87 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:18.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03a79d27-1b49-4d3c-9db8-bab4f8876aea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:18.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03a79d27-1b49-4d3c-9db8-bab4f8876aea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a7991f5 2021-04-14T11:58:18.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03a79d27-1b49-4d3c-9db8-bab4f8876aea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:18.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03a79d27-1b49-4d3c-9db8-bab4f8876aea PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebdb108a-5193-4058-ba49-ca688678a27d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebdb108a-5193-4058-ba49-ca688678a27d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43518d81 2021-04-14T11:58:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebdb108a-5193-4058-ba49-ca688678a27d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebdb108a-5193-4058-ba49-ca688678a27d PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:23.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd5cded-e476-4f3c-a467-f7ac5c34405b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:23.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd5cded-e476-4f3c-a467-f7ac5c34405b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6da1a489 2021-04-14T11:58:23.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd5cded-e476-4f3c-a467-f7ac5c34405b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:23.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfd5cded-e476-4f3c-a467-f7ac5c34405b PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac8eea-5ce8-4b60-8606-2861ae67b9d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac8eea-5ce8-4b60-8606-2861ae67b9d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5646817f 2021-04-14T11:58:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac8eea-5ce8-4b60-8606-2861ae67b9d1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac8eea-5ce8-4b60-8606-2861ae67b9d1 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:30.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=413058b6-a75d-493c-9a02-3ede969f4744 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:30.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=413058b6-a75d-493c-9a02-3ede969f4744 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1076547b 2021-04-14T11:58:30.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=413058b6-a75d-493c-9a02-3ede969f4744 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:30.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=413058b6-a75d-493c-9a02-3ede969f4744 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:33.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381decb1-44ac-44db-8a25-ef13df455ea0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:33.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381decb1-44ac-44db-8a25-ef13df455ea0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f04ee71 2021-04-14T11:58:33.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381decb1-44ac-44db-8a25-ef13df455ea0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:33.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=381decb1-44ac-44db-8a25-ef13df455ea0 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:33.939Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=381decb1-44ac-44db-8a25-ef13df455ea0 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=BE Component ON_BOARDING state changed from DOWN to UP ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:58:33.939Z [BE-Health-Check-Task] INFO o.o.s.c.config.EcompErrorLogUtil alarmSeverity=INFORMATIONAL RequestID=381decb1-44ac-44db-8a25-ef13df455ea0 ErrorCategory=INFO ServiceName=BE Component ON_BOARDING state changed from DOWN to UP TargetServiceName=null ErrorCode=200 PartnerName=SDC.BE TargetEntity=beHealthCheck ASDC Backend Recovery to either one of the following components: JanusGraph DB, Cassandra, Onboarding, UEB Cluster. 2021-04-14T11:58:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1837f59-1b96-4e79-b1ff-a1f4d4b6896f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1837f59-1b96-4e79-b1ff-a1f4d4b6896f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fe18cf4 2021-04-14T11:58:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1837f59-1b96-4e79-b1ff-a1f4d4b6896f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1837f59-1b96-4e79-b1ff-a1f4d4b6896f PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:36.248Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b0f71b69-cc46-45fc-8474-d5241a21423d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:58:36.247836Z InvocationID=e6ef6e0a-b746-4e8c-b95f-c76996135750 LogTimestamp=2021-04-14T11:58:36.247923Z Entering 2021-04-14T11:58:36.248Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b0f71b69-cc46-45fc-8474-d5241a21423d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T11:58:36.247836Z InvocationID=e6ef6e0a-b746-4e8c-b95f-c76996135750 LogTimestamp=2021-04-14T11:58:36.247923Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:58:36.250Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:58:36.248Z InvocationID=6d4b64c0-3c94-49c5-83c6-c02b692ef9fc LogTimestamp=2021-04-14T11:58:36.250595Z ResponseDesc=OK Exiting. 2021-04-14T11:58:36.251Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:58:38.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71efa128-9dd9-4b77-adff-640ebffc40c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:38.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71efa128-9dd9-4b77-adff-640ebffc40c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d4ebf0e 2021-04-14T11:58:38.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71efa128-9dd9-4b77-adff-640ebffc40c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:38.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71efa128-9dd9-4b77-adff-640ebffc40c4 PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=241cce2f-ba7b-41fe-96e3-f67d39b9812c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=241cce2f-ba7b-41fe-96e3-f67d39b9812c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f39fd50 2021-04-14T11:58:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=241cce2f-ba7b-41fe-96e3-f67d39b9812c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=241cce2f-ba7b-41fe-96e3-f67d39b9812c PartnerName=SDC.BE The cassandra down nodes number is 1 2021-04-14T11:58:43.192Z [cluster1-worker-13] INFO com.datastax.driver.core.Cluster Cassandra host cassandra.onap/10.242.70.81:9042 removed 2021-04-14T11:58:43.432Z [cluster2-worker-9] INFO com.datastax.driver.core.Cluster Cassandra host cassandra.onap/10.242.70.81:9042 removed 2021-04-14T11:58:43.436Z [JanusGraph Cluster-worker-7] INFO com.datastax.driver.core.Cluster Cassandra host /10.242.70.81:9042 removed 2021-04-14T11:58:45.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ca3fec-8500-4110-afea-31c038120434 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:45.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ca3fec-8500-4110-afea-31c038120434 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@736e3a0 2021-04-14T11:58:45.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ca3fec-8500-4110-afea-31c038120434 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:45.435Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ca3fec-8500-4110-afea-31c038120434 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:58:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:58:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:58:47.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beb0d5d-c17f-4341-9197-9ed21724686a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beb0d5d-c17f-4341-9197-9ed21724686a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3483499e 2021-04-14T11:58:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beb0d5d-c17f-4341-9197-9ed21724686a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beb0d5d-c17f-4341-9197-9ed21724686a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:58:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cbeae00-2595-4cb3-8e8b-4e06e2ff5684 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cbeae00-2595-4cb3-8e8b-4e06e2ff5684 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c9d36cf 2021-04-14T11:58:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cbeae00-2595-4cb3-8e8b-4e06e2ff5684 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6cbeae00-2595-4cb3-8e8b-4e06e2ff5684 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:58:54.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e426a08-b7f6-486d-8ca5-d5b877e6a11d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:54.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e426a08-b7f6-486d-8ca5-d5b877e6a11d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cfe8b71 2021-04-14T11:58:54.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e426a08-b7f6-486d-8ca5-d5b877e6a11d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:54.062Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e426a08-b7f6-486d-8ca5-d5b877e6a11d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:58:57.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a56d677-e47d-48e4-b289-9d270e124383 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:58:57.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a56d677-e47d-48e4-b289-9d270e124383 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c6546ad 2021-04-14T11:58:57.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a56d677-e47d-48e4-b289-9d270e124383 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:58:57.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a56d677-e47d-48e4-b289-9d270e124383 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=391a0fae-74a2-4c77-baa6-1a8e036e61d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=391a0fae-74a2-4c77-baa6-1a8e036e61d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32842306 2021-04-14T11:59:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=391a0fae-74a2-4c77-baa6-1a8e036e61d1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=391a0fae-74a2-4c77-baa6-1a8e036e61d1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d569125-3d1d-4569-b82a-a1da7ba7bb97 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d569125-3d1d-4569-b82a-a1da7ba7bb97 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47da50d7 2021-04-14T11:59:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d569125-3d1d-4569-b82a-a1da7ba7bb97 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d569125-3d1d-4569-b82a-a1da7ba7bb97 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T11:59:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T11:59:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T11:59:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T11:59:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T11:59:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T11:59:06.249Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9686dded-63fb-4ec8-8ba0-c7abbfa233a7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:59:06.249269Z InvocationID=f6f71ce1-73a4-4121-b4cf-8a98d724b47b LogTimestamp=2021-04-14T11:59:06.249332Z Entering 2021-04-14T11:59:06.249Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9686dded-63fb-4ec8-8ba0-c7abbfa233a7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:59:06.249269Z InvocationID=f6f71ce1-73a4-4121-b4cf-8a98d724b47b LogTimestamp=2021-04-14T11:59:06.249332Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:59:06.251Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:59:06.250Z InvocationID=dc923318-cbf3-4457-b4d1-e8590449dc65 LogTimestamp=2021-04-14T11:59:06.251480Z ResponseDesc=OK Exiting. 2021-04-14T11:59:06.251Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:59:06.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab87d184-32bb-48b1-82bd-2ce92722c7e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:06.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab87d184-32bb-48b1-82bd-2ce92722c7e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fa7ee5e 2021-04-14T11:59:06.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab87d184-32bb-48b1-82bd-2ce92722c7e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:06.385Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab87d184-32bb-48b1-82bd-2ce92722c7e6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe2504c-2405-4624-b3c4-ed5cc11d7144 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe2504c-2405-4624-b3c4-ed5cc11d7144 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29419329 2021-04-14T11:59:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe2504c-2405-4624-b3c4-ed5cc11d7144 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afe2504c-2405-4624-b3c4-ed5cc11d7144 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:12.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2197eef5-7261-4967-8117-e20776986dd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:12.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2197eef5-7261-4967-8117-e20776986dd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a4e0914 2021-04-14T11:59:12.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2197eef5-7261-4967-8117-e20776986dd9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:12.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2197eef5-7261-4967-8117-e20776986dd9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:15.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469e5e86-2942-42a8-a5d1-790f27dbc5a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:15.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469e5e86-2942-42a8-a5d1-790f27dbc5a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f07ba62 2021-04-14T11:59:15.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469e5e86-2942-42a8-a5d1-790f27dbc5a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:15.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=469e5e86-2942-42a8-a5d1-790f27dbc5a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:16.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:18.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5d03ac1-510d-4a56-b654-1ac7e7bc81b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:18.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5d03ac1-510d-4a56-b654-1ac7e7bc81b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ff274c2 2021-04-14T11:59:18.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5d03ac1-510d-4a56-b654-1ac7e7bc81b4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:18.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5d03ac1-510d-4a56-b654-1ac7e7bc81b4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a76aa99c-49ae-41ec-8512-3ac546807106 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a76aa99c-49ae-41ec-8512-3ac546807106 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a8f76ce 2021-04-14T11:59:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a76aa99c-49ae-41ec-8512-3ac546807106 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a76aa99c-49ae-41ec-8512-3ac546807106 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7649ff70-b728-4292-a9c2-0828be1207bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7649ff70-b728-4292-a9c2-0828be1207bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60c3cc22 2021-04-14T11:59:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7649ff70-b728-4292-a9c2-0828be1207bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7649ff70-b728-4292-a9c2-0828be1207bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63d5879-3d17-44f1-81f0-9ac50f7f5e38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63d5879-3d17-44f1-81f0-9ac50f7f5e38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7205aef2 2021-04-14T11:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63d5879-3d17-44f1-81f0-9ac50f7f5e38 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b63d5879-3d17-44f1-81f0-9ac50f7f5e38 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:30.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc97e1be-cd9d-4966-9e84-f726ad7e3829 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:30.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc97e1be-cd9d-4966-9e84-f726ad7e3829 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ecd8014 2021-04-14T11:59:30.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc97e1be-cd9d-4966-9e84-f726ad7e3829 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:30.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc97e1be-cd9d-4966-9e84-f726ad7e3829 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14332e55-f07d-4d8d-9ae9-c0ace63090e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14332e55-f07d-4d8d-9ae9-c0ace63090e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f25b205 2021-04-14T11:59:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14332e55-f07d-4d8d-9ae9-c0ace63090e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:33.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14332e55-f07d-4d8d-9ae9-c0ace63090e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cf08c7-4309-4527-ac97-2ccb783e5a82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cf08c7-4309-4527-ac97-2ccb783e5a82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4179db1f 2021-04-14T11:59:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cf08c7-4309-4527-ac97-2ccb783e5a82 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87cf08c7-4309-4527-ac97-2ccb783e5a82 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:36.268Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7132e9ce-5e3a-4ca1-9e6b-1f47253b38f4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:59:36.268180Z InvocationID=7ee79a7c-5121-4957-9a85-3959aac8eef6 LogTimestamp=2021-04-14T11:59:36.268265Z Entering 2021-04-14T11:59:36.268Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7132e9ce-5e3a-4ca1-9e6b-1f47253b38f4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:59:36.268180Z InvocationID=7ee79a7c-5121-4957-9a85-3959aac8eef6 LogTimestamp=2021-04-14T11:59:36.268265Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:59:36.270Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:59:36.268Z InvocationID=54ce7292-1f3a-45ce-bacb-fc1d68128f3b LogTimestamp=2021-04-14T11:59:36.270178Z ResponseDesc=OK Exiting. 2021-04-14T11:59:36.270Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:59:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c97a43-df41-4b2d-9fc4-0da892c70840 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c97a43-df41-4b2d-9fc4-0da892c70840 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ed49ffc 2021-04-14T11:59:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c97a43-df41-4b2d-9fc4-0da892c70840 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c97a43-df41-4b2d-9fc4-0da892c70840 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f80e13-5b7c-473b-9222-8b5d47a2dd53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f80e13-5b7c-473b-9222-8b5d47a2dd53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c1b6112 2021-04-14T11:59:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f80e13-5b7c-473b-9222-8b5d47a2dd53 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:41.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60f80e13-5b7c-473b-9222-8b5d47a2dd53 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf9155-6d4c-469c-bba4-595ce6c79a9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf9155-6d4c-469c-bba4-595ce6c79a9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e3c5d0e 2021-04-14T11:59:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf9155-6d4c-469c-bba4-595ce6c79a9c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf9155-6d4c-469c-bba4-595ce6c79a9c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T11:59:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T11:59:47.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a38afdf-f48a-4767-b33d-c85e5cce9120 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:47.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a38afdf-f48a-4767-b33d-c85e5cce9120 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@112def5 2021-04-14T11:59:47.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a38afdf-f48a-4767-b33d-c85e5cce9120 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:47.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a38afdf-f48a-4767-b33d-c85e5cce9120 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:48.343Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1d7a5a0a-0542-437a-8c66-685a22f08f79 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:59:48.343310Z InvocationID=4aec67ca-bd4c-420b-acbb-8a0dde7dc464 LogTimestamp=2021-04-14T11:59:48.343364Z Entering 2021-04-14T11:59:48.343Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1d7a5a0a-0542-437a-8c66-685a22f08f79 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T11:59:48.343310Z InvocationID=4aec67ca-bd4c-420b-acbb-8a0dde7dc464 LogTimestamp=2021-04-14T11:59:48.343364Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T11:59:48.345Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T11:59:48.343Z InvocationID=1496ddac-134c-48ea-8c91-f5f2f1ed2674 LogTimestamp=2021-04-14T11:59:48.345191Z ResponseDesc=OK Exiting. 2021-04-14T11:59:48.345Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T11:59:51.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab06ccd-0650-4b29-9c43-1148ca12b72a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:51.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab06ccd-0650-4b29-9c43-1148ca12b72a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b039a54 2021-04-14T11:59:51.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab06ccd-0650-4b29-9c43-1148ca12b72a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:51.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab06ccd-0650-4b29-9c43-1148ca12b72a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:54.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25678b20-b09c-402e-8c46-029b7cbf6cf5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:54.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25678b20-b09c-402e-8c46-029b7cbf6cf5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c576fd7 2021-04-14T11:59:54.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25678b20-b09c-402e-8c46-029b7cbf6cf5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:54.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25678b20-b09c-402e-8c46-029b7cbf6cf5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:57.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11220a8d-e732-4c62-ae89-2f39d0923084 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11220a8d-e732-4c62-ae89-2f39d0923084 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@106f897e 2021-04-14T11:59:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11220a8d-e732-4c62-ae89-2f39d0923084 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11220a8d-e732-4c62-ae89-2f39d0923084 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T11:59:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b3b6ca6-7a5f-4bdc-943a-a305a1aca6e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T11:59:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b3b6ca6-7a5f-4bdc-943a-a305a1aca6e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79d18f0 2021-04-14T11:59:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b3b6ca6-7a5f-4bdc-943a-a305a1aca6e8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T11:59:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b3b6ca6-7a5f-4bdc-943a-a305a1aca6e8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:02.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865fa924-1033-4de7-864c-076f8f4f3d74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:02.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865fa924-1033-4de7-864c-076f8f4f3d74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20ebf36d 2021-04-14T12:00:02.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865fa924-1033-4de7-864c-076f8f4f3d74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:02.732Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=865fa924-1033-4de7-864c-076f8f4f3d74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:00:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:00:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:00:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:00:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:00:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:00:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92090315-abd5-40bc-93e9-394de57fd35a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92090315-abd5-40bc-93e9-394de57fd35a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67851970 2021-04-14T12:00:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92090315-abd5-40bc-93e9-394de57fd35a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92090315-abd5-40bc-93e9-394de57fd35a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:06.252Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1c28d171-954a-4cf2-9770-f122f44cf6a8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:00:06.252063Z InvocationID=b7c936b2-38d8-4ec7-b73f-d8e0cb22484d LogTimestamp=2021-04-14T12:00:06.252111Z Entering 2021-04-14T12:00:06.252Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1c28d171-954a-4cf2-9770-f122f44cf6a8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:00:06.252063Z InvocationID=b7c936b2-38d8-4ec7-b73f-d8e0cb22484d LogTimestamp=2021-04-14T12:00:06.252111Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:00:06.253Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:00:06.252Z InvocationID=beb1d3c7-890e-4d1a-8c47-44a9752065aa LogTimestamp=2021-04-14T12:00:06.253574Z ResponseDesc=OK Exiting. 2021-04-14T12:00:06.253Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:00:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122d6113-2e3b-4cc3-8691-5be37e76298d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122d6113-2e3b-4cc3-8691-5be37e76298d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bcd5887 2021-04-14T12:00:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122d6113-2e3b-4cc3-8691-5be37e76298d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:09.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=122d6113-2e3b-4cc3-8691-5be37e76298d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:12.109Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165b6532-2b4c-43e8-b404-f91a78d7c395 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165b6532-2b4c-43e8-b404-f91a78d7c395 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64788b96 2021-04-14T12:00:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165b6532-2b4c-43e8-b404-f91a78d7c395 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165b6532-2b4c-43e8-b404-f91a78d7c395 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:14.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d645fac-544f-4b93-917c-cce2275a9a30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:14.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d645fac-544f-4b93-917c-cce2275a9a30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bf76cef 2021-04-14T12:00:14.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d645fac-544f-4b93-917c-cce2275a9a30 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:14.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d645fac-544f-4b93-917c-cce2275a9a30 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e8c8d-0030-437b-a03d-84c420159dd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e8c8d-0030-437b-a03d-84c420159dd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5476a878 2021-04-14T12:00:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e8c8d-0030-437b-a03d-84c420159dd4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b4e8c8d-0030-437b-a03d-84c420159dd4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:20.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a280cdbd-ed3c-4a2c-8a7c-4e2eeb4cafad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:20.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a280cdbd-ed3c-4a2c-8a7c-4e2eeb4cafad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@359ecb11 2021-04-14T12:00:20.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a280cdbd-ed3c-4a2c-8a7c-4e2eeb4cafad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:20.870Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a280cdbd-ed3c-4a2c-8a7c-4e2eeb4cafad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ea9f2e6-f2cc-427d-959f-7009fe781982 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ea9f2e6-f2cc-427d-959f-7009fe781982 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@151ac20f 2021-04-14T12:00:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ea9f2e6-f2cc-427d-959f-7009fe781982 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ea9f2e6-f2cc-427d-959f-7009fe781982 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:26.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdfde4c7-2591-4367-bd62-6e03cfc2281b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:26.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdfde4c7-2591-4367-bd62-6e03cfc2281b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35aa4457 2021-04-14T12:00:26.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdfde4c7-2591-4367-bd62-6e03cfc2281b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:26.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdfde4c7-2591-4367-bd62-6e03cfc2281b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed263148-9ba0-4c3a-b5a6-60ad33e79fb5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed263148-9ba0-4c3a-b5a6-60ad33e79fb5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@547e1ff2 2021-04-14T12:00:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed263148-9ba0-4c3a-b5a6-60ad33e79fb5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed263148-9ba0-4c3a-b5a6-60ad33e79fb5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=748e1ec7-6903-478d-b30f-bab3dafb4201 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=748e1ec7-6903-478d-b30f-bab3dafb4201 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17fb802f 2021-04-14T12:00:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=748e1ec7-6903-478d-b30f-bab3dafb4201 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=748e1ec7-6903-478d-b30f-bab3dafb4201 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:34.607Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01s8tocmgso29w1qvvwz3ph84gt173 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02umcspuas45k1lzrhblc0cmcp196 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015pjiqv60r46l1dlb52rwdezcp207 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0x1u8o5kjhnup1cn1l1i50dxmx195 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04vjk9qlr5zqd1izapb98prrnt183 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01b1x6ay52ylt125zoeq2abqkk189 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0oxv09n6ua043jisc93lyw1x194 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ce9lvz4y1pjztmlr74djpi74198 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tatjay2911nj1ox87vlhmjsn6181 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ujds4zoulade1qpqsgot5s2sf206 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05luipq5ibwgcpgxfk4h7ls0v197 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01uipx225l41o8s8nw6fa6lt2i178 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01md1s1pffm53k17vff33gjbgsp188 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013ewz2d0qkbqz1msizytrc16nm186 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01p3zkswwoc0t2rv7oxrv2tecg185 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0md8z9qj6xy211bddg5voum3ha201 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yq5l3t2afok4mrimv6k9uamw174 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01jt00olvv1iyq1eolftqaggnwx205 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01c8cv33q7k8s7smbva1jlfnja200 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01e7oerjeeid6igd6bnmf1t655193 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01srxhuj4oklivbyrb3y1oevb3187 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k9gbv7go6q1y1jvo4cph3gd1b208 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0n3ow6dydjxst12w653hrooizw199 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0jmqvb7r4dyv3adfs940m0kcv203 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05x1hnnsanot2fj64sozmblh5192 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01otw38jefkl8c138xfrf0apm5u204 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ve5qrlqcpuxa1a2ickhzi06ao191 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09w79n373noaw11343hirt17wh182 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012tz9h268aj3xzz6j9t4vw1e9179 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ml5dqf94693tguz2tm12kq1176 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s6211odmsf3cw7i33bqq2ihe184 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010ubbualfv2tpm37x0h2tyg9w190 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0tycy8x8rgl47meujuenblbpx175 2021-04-14T12:00:34.608Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ym5j3caa3sts1o56aqhsmva3r180 2021-04-14T12:00:34.609Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0x3euc5mmzelb1nsyxx36g1dcf177 2021-04-14T12:00:34.609Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xkvebdyjv7q31mieup5o41b7u202 2021-04-14T12:00:35.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53abf15b-76c5-4a0b-b134-722694bf1399 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:35.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53abf15b-76c5-4a0b-b134-722694bf1399 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54322265 2021-04-14T12:00:35.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53abf15b-76c5-4a0b-b134-722694bf1399 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:35.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53abf15b-76c5-4a0b-b134-722694bf1399 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:36.227Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5e8b6614-6810-4035-afed-d0c9cb53e4d9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:00:36.226961Z InvocationID=6b9051b8-5f0f-47b5-8328-41dc8d61d003 LogTimestamp=2021-04-14T12:00:36.227038Z Entering 2021-04-14T12:00:36.227Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5e8b6614-6810-4035-afed-d0c9cb53e4d9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:00:36.226961Z InvocationID=6b9051b8-5f0f-47b5-8328-41dc8d61d003 LogTimestamp=2021-04-14T12:00:36.227038Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:00:36.228Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:00:36.227Z InvocationID=8f40fa4c-7709-4482-be82-dc95da93f843 LogTimestamp=2021-04-14T12:00:36.228373Z ResponseDesc=OK Exiting. 2021-04-14T12:00:36.228Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:00:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615112ba-6233-4e05-b37f-b989a255e3a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615112ba-6233-4e05-b37f-b989a255e3a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33dd5c48 2021-04-14T12:00:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615112ba-6233-4e05-b37f-b989a255e3a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=615112ba-6233-4e05-b37f-b989a255e3a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c9328a7-1878-423c-b050-6431c305774e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c9328a7-1878-423c-b050-6431c305774e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1778544e 2021-04-14T12:00:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c9328a7-1878-423c-b050-6431c305774e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c9328a7-1878-423c-b050-6431c305774e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d64160d-1195-4272-9ac2-69aaf93a61d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d64160d-1195-4272-9ac2-69aaf93a61d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cc95476 2021-04-14T12:00:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d64160d-1195-4272-9ac2-69aaf93a61d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d64160d-1195-4272-9ac2-69aaf93a61d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:46.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:00:46.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:00:48.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=740fc327-9950-4f9b-bb66-3e47828a05cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:48.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=740fc327-9950-4f9b-bb66-3e47828a05cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@192d7480 2021-04-14T12:00:48.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=740fc327-9950-4f9b-bb66-3e47828a05cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:48.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=740fc327-9950-4f9b-bb66-3e47828a05cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:51.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c0d302-d67b-4525-b40b-c73cf3032665 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:51.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c0d302-d67b-4525-b40b-c73cf3032665 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40cb44f1 2021-04-14T12:00:51.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c0d302-d67b-4525-b40b-c73cf3032665 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:51.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66c0d302-d67b-4525-b40b-c73cf3032665 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:54.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=527796e1-964c-4ff4-a024-6d10b619f37a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:54.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=527796e1-964c-4ff4-a024-6d10b619f37a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15c4b282 2021-04-14T12:00:54.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=527796e1-964c-4ff4-a024-6d10b619f37a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:54.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=527796e1-964c-4ff4-a024-6d10b619f37a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a869a152-c4c4-4de1-b62f-1566de14f41c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a869a152-c4c4-4de1-b62f-1566de14f41c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b82ea8 2021-04-14T12:00:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a869a152-c4c4-4de1-b62f-1566de14f41c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a869a152-c4c4-4de1-b62f-1566de14f41c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:00:59.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1dbc75-b235-4ead-a33f-6744e9def388 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:00:59.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1dbc75-b235-4ead-a33f-6744e9def388 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71c3c32b 2021-04-14T12:00:59.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1dbc75-b235-4ead-a33f-6744e9def388 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:00:59.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1dbc75-b235-4ead-a33f-6744e9def388 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:02.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9dad7b-72e5-4791-ae89-718732658262 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9dad7b-72e5-4791-ae89-718732658262 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b35ed2e 2021-04-14T12:01:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9dad7b-72e5-4791-ae89-718732658262 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a9dad7b-72e5-4791-ae89-718732658262 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:01:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:01:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:01:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:01:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:01:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:01:06.239Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1a5a6611-4cd2-4a15-8777-4ee84dc9636b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:01:06.238731Z InvocationID=5f612eca-b53d-44e7-a910-c558298362bf LogTimestamp=2021-04-14T12:01:06.238853Z Entering 2021-04-14T12:01:06.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1a5a6611-4cd2-4a15-8777-4ee84dc9636b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:01:06.238731Z InvocationID=5f612eca-b53d-44e7-a910-c558298362bf LogTimestamp=2021-04-14T12:01:06.238853Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:01:06.242Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:01:06.239Z InvocationID=4eb43df8-31ef-485b-aeed-8de63f2578dd LogTimestamp=2021-04-14T12:01:06.242279Z ResponseDesc=OK Exiting. 2021-04-14T12:01:06.242Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:01:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6a3846-339b-4275-be40-fb74d93cb257 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6a3846-339b-4275-be40-fb74d93cb257 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bd51268 2021-04-14T12:01:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6a3846-339b-4275-be40-fb74d93cb257 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:06.483Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a6a3846-339b-4275-be40-fb74d93cb257 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79a19bb-48f6-4c94-b358-2a4b3a4dc531 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79a19bb-48f6-4c94-b358-2a4b3a4dc531 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@195aaad4 2021-04-14T12:01:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79a19bb-48f6-4c94-b358-2a4b3a4dc531 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79a19bb-48f6-4c94-b358-2a4b3a4dc531 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7472cc-0dcd-448c-af70-6aa4e0074c04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7472cc-0dcd-448c-af70-6aa4e0074c04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76eff84f 2021-04-14T12:01:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7472cc-0dcd-448c-af70-6aa4e0074c04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a7472cc-0dcd-448c-af70-6aa4e0074c04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c554b7-ae9c-4465-a285-29bb4e30cd70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c554b7-ae9c-4465-a285-29bb4e30cd70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32772721 2021-04-14T12:01:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c554b7-ae9c-4465-a285-29bb4e30cd70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6c554b7-ae9c-4465-a285-29bb4e30cd70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:16.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:17.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=617c6b14-3d46-4b18-8788-4c5582109b0c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:17.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=617c6b14-3d46-4b18-8788-4c5582109b0c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41423555 2021-04-14T12:01:17.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=617c6b14-3d46-4b18-8788-4c5582109b0c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:17.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=617c6b14-3d46-4b18-8788-4c5582109b0c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db5a84e-f26c-4e17-a01f-96d26dc39baa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db5a84e-f26c-4e17-a01f-96d26dc39baa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d023ba3 2021-04-14T12:01:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db5a84e-f26c-4e17-a01f-96d26dc39baa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db5a84e-f26c-4e17-a01f-96d26dc39baa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1abe6a-5d89-4ff2-a07f-c452e5f94bda PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1abe6a-5d89-4ff2-a07f-c452e5f94bda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a697cc 2021-04-14T12:01:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1abe6a-5d89-4ff2-a07f-c452e5f94bda PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb1abe6a-5d89-4ff2-a07f-c452e5f94bda PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:27.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6b9414-6d75-4ce4-9cce-84be12401878 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:27.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6b9414-6d75-4ce4-9cce-84be12401878 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f63e656 2021-04-14T12:01:27.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6b9414-6d75-4ce4-9cce-84be12401878 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:27.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db6b9414-6d75-4ce4-9cce-84be12401878 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc00a1c-5fcb-4f51-a72d-ebf92b10ecff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc00a1c-5fcb-4f51-a72d-ebf92b10ecff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5fdb9272 2021-04-14T12:01:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc00a1c-5fcb-4f51-a72d-ebf92b10ecff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fc00a1c-5fcb-4f51-a72d-ebf92b10ecff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f551f7ed-91da-4747-9fc8-feff032f9013 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f551f7ed-91da-4747-9fc8-feff032f9013 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43186509 2021-04-14T12:01:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f551f7ed-91da-4747-9fc8-feff032f9013 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f551f7ed-91da-4747-9fc8-feff032f9013 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d22bfe2-ffe9-4f45-9c6f-8deed4119431 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d22bfe2-ffe9-4f45-9c6f-8deed4119431 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73b08251 2021-04-14T12:01:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d22bfe2-ffe9-4f45-9c6f-8deed4119431 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d22bfe2-ffe9-4f45-9c6f-8deed4119431 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:36.242Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a983b561-dd9e-4722-a5f7-89a332aad9e1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:01:36.241914Z InvocationID=f91319b3-851e-4de6-8e76-0e63be22cbd1 LogTimestamp=2021-04-14T12:01:36.241988Z Entering 2021-04-14T12:01:36.242Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a983b561-dd9e-4722-a5f7-89a332aad9e1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:01:36.241914Z InvocationID=f91319b3-851e-4de6-8e76-0e63be22cbd1 LogTimestamp=2021-04-14T12:01:36.241988Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:01:36.246Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:01:36.243Z InvocationID=26138234-b6ab-4145-bb4a-ae187be83b49 LogTimestamp=2021-04-14T12:01:36.246238Z ResponseDesc=OK Exiting. 2021-04-14T12:01:36.246Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:01:38.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483c6574-93fb-4ff8-9f3f-440bb32e9d84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:38.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483c6574-93fb-4ff8-9f3f-440bb32e9d84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63f19b27 2021-04-14T12:01:38.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483c6574-93fb-4ff8-9f3f-440bb32e9d84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:38.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483c6574-93fb-4ff8-9f3f-440bb32e9d84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3967ea-1042-4f90-9d33-0e4ec3f90793 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3967ea-1042-4f90-9d33-0e4ec3f90793 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@603acd29 2021-04-14T12:01:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3967ea-1042-4f90-9d33-0e4ec3f90793 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3967ea-1042-4f90-9d33-0e4ec3f90793 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:44.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccae83dc-140f-444a-9e99-b76a3414e0f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:44.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccae83dc-140f-444a-9e99-b76a3414e0f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@608adc0a 2021-04-14T12:01:44.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccae83dc-140f-444a-9e99-b76a3414e0f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:44.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccae83dc-140f-444a-9e99-b76a3414e0f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:01:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:01:48.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e27d040-9262-4f89-93b7-8117a8144427 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e27d040-9262-4f89-93b7-8117a8144427 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@175f6840 2021-04-14T12:01:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e27d040-9262-4f89-93b7-8117a8144427 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e27d040-9262-4f89-93b7-8117a8144427 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:48.237Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4aa1c773-b59a-4b0a-b745-208ef015bcb3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:01:48.236807Z InvocationID=935b0c90-79a0-4dc5-8b1f-0cfb07120539 LogTimestamp=2021-04-14T12:01:48.236864Z Entering 2021-04-14T12:01:48.237Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4aa1c773-b59a-4b0a-b745-208ef015bcb3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:01:48.236807Z InvocationID=935b0c90-79a0-4dc5-8b1f-0cfb07120539 LogTimestamp=2021-04-14T12:01:48.236864Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:01:48.238Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:01:48.237Z InvocationID=03309d27-42a8-4ca6-aa9f-0ac00537af29 LogTimestamp=2021-04-14T12:01:48.238400Z ResponseDesc=OK Exiting. 2021-04-14T12:01:48.238Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dea2f70-fa73-442d-950d-11c1a96e6c2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dea2f70-fa73-442d-950d-11c1a96e6c2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7818f12f 2021-04-14T12:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dea2f70-fa73-442d-950d-11c1a96e6c2b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dea2f70-fa73-442d-950d-11c1a96e6c2b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a50f9993-3072-42c9-80ed-eb7aacc91a1f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a50f9993-3072-42c9-80ed-eb7aacc91a1f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4efd3880 2021-04-14T12:01:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a50f9993-3072-42c9-80ed-eb7aacc91a1f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a50f9993-3072-42c9-80ed-eb7aacc91a1f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:56.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd582685-01cc-4d37-9e64-e77ab7da7a06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:56.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd582685-01cc-4d37-9e64-e77ab7da7a06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7821d7d9 2021-04-14T12:01:56.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd582685-01cc-4d37-9e64-e77ab7da7a06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:56.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd582685-01cc-4d37-9e64-e77ab7da7a06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:01:59.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f25f4d6-a7e8-4f80-87a6-7e66a64e3a66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:01:59.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f25f4d6-a7e8-4f80-87a6-7e66a64e3a66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1450bdf5 2021-04-14T12:01:59.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f25f4d6-a7e8-4f80-87a6-7e66a64e3a66 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:01:59.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f25f4d6-a7e8-4f80-87a6-7e66a64e3a66 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7dded7d-edd7-4a03-8e02-794e55adc2a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7dded7d-edd7-4a03-8e02-794e55adc2a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bfeb7d9 2021-04-14T12:02:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7dded7d-edd7-4a03-8e02-794e55adc2a2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7dded7d-edd7-4a03-8e02-794e55adc2a2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:02:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:02:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:02:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:02:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:02:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:02:06.240Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3f87b5a8-db6a-4546-8820-5ad0c0d7e181 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:02:06.239470Z InvocationID=d2405a3e-2468-49dc-b11b-855499c1591b LogTimestamp=2021-04-14T12:02:06.239557Z Entering 2021-04-14T12:02:06.240Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3f87b5a8-db6a-4546-8820-5ad0c0d7e181 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:02:06.239470Z InvocationID=d2405a3e-2468-49dc-b11b-855499c1591b LogTimestamp=2021-04-14T12:02:06.239557Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:02:06.242Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:02:06.240Z InvocationID=3b5bfa87-2aaa-449e-93d2-2a7485cf4e4c LogTimestamp=2021-04-14T12:02:06.242563Z ResponseDesc=OK Exiting. 2021-04-14T12:02:06.242Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:02:06.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5644eb5a-6fb1-4f51-be78-4fcff0678cbf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:06.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5644eb5a-6fb1-4f51-be78-4fcff0678cbf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c60a31e 2021-04-14T12:02:06.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5644eb5a-6fb1-4f51-be78-4fcff0678cbf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:06.331Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5644eb5a-6fb1-4f51-be78-4fcff0678cbf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522a013f-5a40-4a41-86a8-8ef1a71af161 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522a013f-5a40-4a41-86a8-8ef1a71af161 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a092254 2021-04-14T12:02:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522a013f-5a40-4a41-86a8-8ef1a71af161 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=522a013f-5a40-4a41-86a8-8ef1a71af161 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0524b85d-e6dc-4366-94a3-868454fdf3a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0524b85d-e6dc-4366-94a3-868454fdf3a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ba797f5 2021-04-14T12:02:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0524b85d-e6dc-4366-94a3-868454fdf3a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0524b85d-e6dc-4366-94a3-868454fdf3a7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=262ca297-eaae-433c-acb6-958b71186466 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=262ca297-eaae-433c-acb6-958b71186466 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35b9b527 2021-04-14T12:02:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=262ca297-eaae-433c-acb6-958b71186466 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=262ca297-eaae-433c-acb6-958b71186466 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:16.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:16.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:16.205Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:16.206Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a54921-0ce7-40e3-8be3-59e5dfa73197 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a54921-0ce7-40e3-8be3-59e5dfa73197 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cc888dd 2021-04-14T12:02:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a54921-0ce7-40e3-8be3-59e5dfa73197 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:17.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02a54921-0ce7-40e3-8be3-59e5dfa73197 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3568532-8393-420e-a1e9-3a3fdab8c916 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3568532-8393-420e-a1e9-3a3fdab8c916 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f600692 2021-04-14T12:02:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3568532-8393-420e-a1e9-3a3fdab8c916 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3568532-8393-420e-a1e9-3a3fdab8c916 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:24.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5030dfd2-0b4b-480b-8a9c-0a6907f10025 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:24.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5030dfd2-0b4b-480b-8a9c-0a6907f10025 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58af20b4 2021-04-14T12:02:24.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5030dfd2-0b4b-480b-8a9c-0a6907f10025 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5030dfd2-0b4b-480b-8a9c-0a6907f10025 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:27.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe9616d-3995-4bc8-a51a-b905197e6b7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:27.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe9616d-3995-4bc8-a51a-b905197e6b7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20c7a60b 2021-04-14T12:02:27.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe9616d-3995-4bc8-a51a-b905197e6b7d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:27.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe9616d-3995-4bc8-a51a-b905197e6b7d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:30.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f72b9-5d93-405e-88a6-8c60d84fa39a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:30.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f72b9-5d93-405e-88a6-8c60d84fa39a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58b15cae 2021-04-14T12:02:30.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f72b9-5d93-405e-88a6-8c60d84fa39a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:30.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f72b9-5d93-405e-88a6-8c60d84fa39a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:32.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=260206e4-8a3b-44d8-ab1a-b96fc6a34409 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:32.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=260206e4-8a3b-44d8-ab1a-b96fc6a34409 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57ea95bc 2021-04-14T12:02:32.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=260206e4-8a3b-44d8-ab1a-b96fc6a34409 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:32.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=260206e4-8a3b-44d8-ab1a-b96fc6a34409 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e53759-181f-4a14-bf1e-57021b26c3c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e53759-181f-4a14-bf1e-57021b26c3c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76e1b575 2021-04-14T12:02:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e53759-181f-4a14-bf1e-57021b26c3c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49e53759-181f-4a14-bf1e-57021b26c3c0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:36.233Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0be4f54f-7999-4067-a4ea-3a74c01dabbd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:02:36.232676Z InvocationID=7e95b47a-3d49-4757-9d29-96fdf399eaf7 LogTimestamp=2021-04-14T12:02:36.232787Z Entering 2021-04-14T12:02:36.233Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0be4f54f-7999-4067-a4ea-3a74c01dabbd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:02:36.232676Z InvocationID=7e95b47a-3d49-4757-9d29-96fdf399eaf7 LogTimestamp=2021-04-14T12:02:36.232787Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:02:36.236Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:02:36.233Z InvocationID=da270e82-ee8e-4095-b621-9d59b3f2e260 LogTimestamp=2021-04-14T12:02:36.236435Z ResponseDesc=OK Exiting. 2021-04-14T12:02:36.236Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:02:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3954c2f5-e8c0-48a2-8b58-3aaa9db1843f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3954c2f5-e8c0-48a2-8b58-3aaa9db1843f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b8ba25c 2021-04-14T12:02:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3954c2f5-e8c0-48a2-8b58-3aaa9db1843f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3954c2f5-e8c0-48a2-8b58-3aaa9db1843f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2456df-3229-4df9-b851-0b1cdbfc52eb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2456df-3229-4df9-b851-0b1cdbfc52eb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@390dd7af 2021-04-14T12:02:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2456df-3229-4df9-b851-0b1cdbfc52eb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a2456df-3229-4df9-b851-0b1cdbfc52eb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68fdfa74-b247-45eb-a603-2fae9955e00c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68fdfa74-b247-45eb-a603-2fae9955e00c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a49f247 2021-04-14T12:02:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68fdfa74-b247-45eb-a603-2fae9955e00c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:44.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68fdfa74-b247-45eb-a603-2fae9955e00c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:02:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:02:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb541755-bb7f-4388-b0ff-5f9eaf0ee652 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb541755-bb7f-4388-b0ff-5f9eaf0ee652 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41f8b266 2021-04-14T12:02:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb541755-bb7f-4388-b0ff-5f9eaf0ee652 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb541755-bb7f-4388-b0ff-5f9eaf0ee652 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:51.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acab113-f555-4c4b-8585-107b2fd9673c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acab113-f555-4c4b-8585-107b2fd9673c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77576147 2021-04-14T12:02:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acab113-f555-4c4b-8585-107b2fd9673c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4acab113-f555-4c4b-8585-107b2fd9673c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:53.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f063677-e697-47b6-9477-d6d78e5bcbeb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:53.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f063677-e697-47b6-9477-d6d78e5bcbeb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@203070ad 2021-04-14T12:02:53.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f063677-e697-47b6-9477-d6d78e5bcbeb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:53.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f063677-e697-47b6-9477-d6d78e5bcbeb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7749d74e-2122-458d-9eea-e6b03178ed06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7749d74e-2122-458d-9eea-e6b03178ed06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@551e7526 2021-04-14T12:02:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7749d74e-2122-458d-9eea-e6b03178ed06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7749d74e-2122-458d-9eea-e6b03178ed06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:02:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18cc0cf0-f325-4512-b907-518d0fa49bbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:02:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18cc0cf0-f325-4512-b907-518d0fa49bbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51f19661 2021-04-14T12:02:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18cc0cf0-f325-4512-b907-518d0fa49bbb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:02:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18cc0cf0-f325-4512-b907-518d0fa49bbb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9cd19e9-5ff3-4b69-b6ab-6172710e8934 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9cd19e9-5ff3-4b69-b6ab-6172710e8934 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d608841 2021-04-14T12:03:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9cd19e9-5ff3-4b69-b6ab-6172710e8934 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:02.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9cd19e9-5ff3-4b69-b6ab-6172710e8934 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:03:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:03:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:03:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:03:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:03:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:03:06.230Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2021e10a-9043-47b5-9f8d-1086aa072f30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:03:06.229940Z InvocationID=88fa852b-5820-487f-9a76-bec6bb51008f LogTimestamp=2021-04-14T12:03:06.230029Z Entering 2021-04-14T12:03:06.230Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2021e10a-9043-47b5-9f8d-1086aa072f30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:03:06.229940Z InvocationID=88fa852b-5820-487f-9a76-bec6bb51008f LogTimestamp=2021-04-14T12:03:06.230029Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:03:06.236Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:03:06.234Z InvocationID=c3ac8813-ecb8-432f-bdda-2d879d1c2796 LogTimestamp=2021-04-14T12:03:06.236215Z ResponseDesc=OK Exiting. 2021-04-14T12:03:06.236Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:03:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a198c5e6-9c9e-4a0b-80f4-b0af9a26ae4e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a198c5e6-9c9e-4a0b-80f4-b0af9a26ae4e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ef62658 2021-04-14T12:03:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a198c5e6-9c9e-4a0b-80f4-b0af9a26ae4e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a198c5e6-9c9e-4a0b-80f4-b0af9a26ae4e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:09.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=462bf3cf-6ae5-4084-9320-3ead35c697e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:09.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=462bf3cf-6ae5-4084-9320-3ead35c697e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18e7d3e5 2021-04-14T12:03:09.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=462bf3cf-6ae5-4084-9320-3ead35c697e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:09.107Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=462bf3cf-6ae5-4084-9320-3ead35c697e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788b7736-f338-4c63-8f63-0b2fd67c7dcd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788b7736-f338-4c63-8f63-0b2fd67c7dcd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45f81c06 2021-04-14T12:03:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788b7736-f338-4c63-8f63-0b2fd67c7dcd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=788b7736-f338-4c63-8f63-0b2fd67c7dcd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7565b50-60d9-41ef-aab2-3c1e39c73652 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7565b50-60d9-41ef-aab2-3c1e39c73652 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cc3a678 2021-04-14T12:03:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7565b50-60d9-41ef-aab2-3c1e39c73652 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7565b50-60d9-41ef-aab2-3c1e39c73652 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:16.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:16.204Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:16.208Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:18.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2576bd05-aa02-4777-87db-358443b4a974 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:18.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2576bd05-aa02-4777-87db-358443b4a974 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53889f5e 2021-04-14T12:03:18.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2576bd05-aa02-4777-87db-358443b4a974 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:18.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2576bd05-aa02-4777-87db-358443b4a974 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:20.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cdff2f7-3e1c-4e12-962b-be7a8345d9dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:20.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cdff2f7-3e1c-4e12-962b-be7a8345d9dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75561631 2021-04-14T12:03:20.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cdff2f7-3e1c-4e12-962b-be7a8345d9dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:20.600Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cdff2f7-3e1c-4e12-962b-be7a8345d9dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:24.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dc62ab2-ef26-4872-ac46-11240f6e15e0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:24.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dc62ab2-ef26-4872-ac46-11240f6e15e0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@704b3cb1 2021-04-14T12:03:24.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dc62ab2-ef26-4872-ac46-11240f6e15e0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:24.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0dc62ab2-ef26-4872-ac46-11240f6e15e0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:27.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6214c6eb-6433-4fbd-ace2-c3692986513d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:27.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6214c6eb-6433-4fbd-ace2-c3692986513d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@317ab4a6 2021-04-14T12:03:27.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6214c6eb-6433-4fbd-ace2-c3692986513d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:27.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6214c6eb-6433-4fbd-ace2-c3692986513d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85a58c3a-407e-4dc4-9bd1-3dd6cb6e6588 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85a58c3a-407e-4dc4-9bd1-3dd6cb6e6588 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@261fafb8 2021-04-14T12:03:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85a58c3a-407e-4dc4-9bd1-3dd6cb6e6588 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:30.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85a58c3a-407e-4dc4-9bd1-3dd6cb6e6588 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:31.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:31.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=905dfb57-8b24-4f68-ae3c-6852e544ca58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=905dfb57-8b24-4f68-ae3c-6852e544ca58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63bdd2d4 2021-04-14T12:03:33.421Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=905dfb57-8b24-4f68-ae3c-6852e544ca58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:33.422Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=905dfb57-8b24-4f68-ae3c-6852e544ca58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:36.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=327aca44-87ca-4445-8e64-d968ce983f9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:36.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=327aca44-87ca-4445-8e64-d968ce983f9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4abac4a6 2021-04-14T12:03:36.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=327aca44-87ca-4445-8e64-d968ce983f9d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:36.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=327aca44-87ca-4445-8e64-d968ce983f9d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:36.245Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cbf964de-b64a-4bf9-b640-734c68118c7d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:03:36.245349Z InvocationID=fe054863-9dd9-40e8-b083-e0f1209aabe6 LogTimestamp=2021-04-14T12:03:36.245433Z Entering 2021-04-14T12:03:36.246Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cbf964de-b64a-4bf9-b640-734c68118c7d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:03:36.245349Z InvocationID=fe054863-9dd9-40e8-b083-e0f1209aabe6 LogTimestamp=2021-04-14T12:03:36.245433Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:03:36.248Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:03:36.246Z InvocationID=face53a5-9cb4-491e-bb08-6ff284c82630 LogTimestamp=2021-04-14T12:03:36.248466Z ResponseDesc=OK Exiting. 2021-04-14T12:03:36.248Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:03:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512ec822-69e4-4fce-8455-0ac8d8baf4db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512ec822-69e4-4fce-8455-0ac8d8baf4db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e8186d3 2021-04-14T12:03:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512ec822-69e4-4fce-8455-0ac8d8baf4db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:39.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=512ec822-69e4-4fce-8455-0ac8d8baf4db PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:41.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86936f56-089a-44dd-acfb-1ecb08dc266f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:41.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86936f56-089a-44dd-acfb-1ecb08dc266f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75388ed4 2021-04-14T12:03:41.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86936f56-089a-44dd-acfb-1ecb08dc266f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:41.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86936f56-089a-44dd-acfb-1ecb08dc266f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1ece5c-1721-4504-ad6d-75f9d7ce5d5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1ece5c-1721-4504-ad6d-75f9d7ce5d5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@789ec9d5 2021-04-14T12:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1ece5c-1721-4504-ad6d-75f9d7ce5d5c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d1ece5c-1721-4504-ad6d-75f9d7ce5d5c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:03:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:03:48.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a7290d4-3cae-4e6f-bd4b-ea40df4ff6c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:48.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a7290d4-3cae-4e6f-bd4b-ea40df4ff6c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@641dad94 2021-04-14T12:03:48.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a7290d4-3cae-4e6f-bd4b-ea40df4ff6c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:48.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a7290d4-3cae-4e6f-bd4b-ea40df4ff6c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:48.232Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=503eb0a4-8e26-41d8-80cd-d977a932cbf5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:03:48.231840Z InvocationID=100061e9-5a23-4068-948b-3d0f4e9cda66 LogTimestamp=2021-04-14T12:03:48.231883Z Entering 2021-04-14T12:03:48.232Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=503eb0a4-8e26-41d8-80cd-d977a932cbf5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:03:48.231840Z InvocationID=100061e9-5a23-4068-948b-3d0f4e9cda66 LogTimestamp=2021-04-14T12:03:48.231883Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:03:48.234Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:03:48.232Z InvocationID=9f6e47f4-3280-4676-9406-3df6e12d0235 LogTimestamp=2021-04-14T12:03:48.234277Z ResponseDesc=OK Exiting. 2021-04-14T12:03:48.234Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:03:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd286d1-c47c-41b9-8944-0ab1b70b7283 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd286d1-c47c-41b9-8944-0ab1b70b7283 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@468808da 2021-04-14T12:03:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd286d1-c47c-41b9-8944-0ab1b70b7283 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:51.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd286d1-c47c-41b9-8944-0ab1b70b7283 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a8485f-cf88-4b26-8c3c-ed59344be4d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a8485f-cf88-4b26-8c3c-ed59344be4d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77f760f1 2021-04-14T12:03:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a8485f-cf88-4b26-8c3c-ed59344be4d1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09a8485f-cf88-4b26-8c3c-ed59344be4d1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:57.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b3fd25-0332-4d39-81aa-d5210c1d0962 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:57.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b3fd25-0332-4d39-81aa-d5210c1d0962 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79a9dfbb 2021-04-14T12:03:57.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b3fd25-0332-4d39-81aa-d5210c1d0962 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:57.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38b3fd25-0332-4d39-81aa-d5210c1d0962 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:03:59.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdbd29e5-d931-4039-b98d-63024a0782f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:03:59.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdbd29e5-d931-4039-b98d-63024a0782f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7051bc17 2021-04-14T12:03:59.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdbd29e5-d931-4039-b98d-63024a0782f5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:03:59.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdbd29e5-d931-4039-b98d-63024a0782f5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:01.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:02.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deeae436-071e-47d1-b053-a033ae27aacd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:02.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deeae436-071e-47d1-b053-a033ae27aacd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7699a41f 2021-04-14T12:04:02.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deeae436-071e-47d1-b053-a033ae27aacd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:02.735Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deeae436-071e-47d1-b053-a033ae27aacd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:04:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:04:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:04:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:04:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:04:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:04:06.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216dac3b-9e5d-4eae-a73b-43604053e96d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:06.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216dac3b-9e5d-4eae-a73b-43604053e96d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3aa5b2d5 2021-04-14T12:04:06.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216dac3b-9e5d-4eae-a73b-43604053e96d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:06.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216dac3b-9e5d-4eae-a73b-43604053e96d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:06.234Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d5b767c6-8edc-4585-8a65-fcc2d5bcd8da InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:04:06.233705Z InvocationID=aa47dd3f-d916-4179-9ddb-3b1934b45b11 LogTimestamp=2021-04-14T12:04:06.233770Z Entering 2021-04-14T12:04:06.234Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d5b767c6-8edc-4585-8a65-fcc2d5bcd8da InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:04:06.233705Z InvocationID=aa47dd3f-d916-4179-9ddb-3b1934b45b11 LogTimestamp=2021-04-14T12:04:06.233770Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:04:06.235Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:04:06.234Z InvocationID=ac5834f4-024c-404e-889b-1b7ac4f09a31 LogTimestamp=2021-04-14T12:04:06.235333Z ResponseDesc=OK Exiting. 2021-04-14T12:04:06.235Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:04:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ee9444-dae0-48b6-ac0b-7a7d63e5730a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ee9444-dae0-48b6-ac0b-7a7d63e5730a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d46f63d 2021-04-14T12:04:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ee9444-dae0-48b6-ac0b-7a7d63e5730a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ee9444-dae0-48b6-ac0b-7a7d63e5730a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d0e0ac6-4127-47d8-9dc0-7934bc13a8a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d0e0ac6-4127-47d8-9dc0-7934bc13a8a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@700a4286 2021-04-14T12:04:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d0e0ac6-4127-47d8-9dc0-7934bc13a8a2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d0e0ac6-4127-47d8-9dc0-7934bc13a8a2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d974279-3b8f-4dd8-959b-fbfebf2b29ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d974279-3b8f-4dd8-959b-fbfebf2b29ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b08b9c4 2021-04-14T12:04:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d974279-3b8f-4dd8-959b-fbfebf2b29ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d974279-3b8f-4dd8-959b-fbfebf2b29ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:16.211Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:16.212Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:17.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73adef8d-cfc0-4103-89b0-536d6fd45476 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:17.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73adef8d-cfc0-4103-89b0-536d6fd45476 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cac996a 2021-04-14T12:04:17.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73adef8d-cfc0-4103-89b0-536d6fd45476 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:17.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73adef8d-cfc0-4103-89b0-536d6fd45476 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0f32f1a-6575-4374-bda7-3795d9cb89bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0f32f1a-6575-4374-bda7-3795d9cb89bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66616bdc 2021-04-14T12:04:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0f32f1a-6575-4374-bda7-3795d9cb89bd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0f32f1a-6575-4374-bda7-3795d9cb89bd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:24.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2386b508-64cb-46f9-8b0e-f096791e8981 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:24.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2386b508-64cb-46f9-8b0e-f096791e8981 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44dd1be4 2021-04-14T12:04:24.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2386b508-64cb-46f9-8b0e-f096791e8981 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:24.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2386b508-64cb-46f9-8b0e-f096791e8981 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:27.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b597f36a-1ea8-4856-95b1-53d11e64edd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:27.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b597f36a-1ea8-4856-95b1-53d11e64edd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a154c22 2021-04-14T12:04:27.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b597f36a-1ea8-4856-95b1-53d11e64edd5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:27.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b597f36a-1ea8-4856-95b1-53d11e64edd5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f17cf83-6d93-43d7-9f3f-d9debf5d2040 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f17cf83-6d93-43d7-9f3f-d9debf5d2040 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72caebc3 2021-04-14T12:04:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f17cf83-6d93-43d7-9f3f-d9debf5d2040 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f17cf83-6d93-43d7-9f3f-d9debf5d2040 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:33.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=430b48bd-3d54-4a74-9829-4cf736956bf0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:33.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=430b48bd-3d54-4a74-9829-4cf736956bf0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f1841cd 2021-04-14T12:04:33.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=430b48bd-3d54-4a74-9829-4cf736956bf0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:33.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=430b48bd-3d54-4a74-9829-4cf736956bf0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:35.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4de12fc1-bd53-4c06-b513-2c31ff4542cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:35.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4de12fc1-bd53-4c06-b513-2c31ff4542cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33b67bf1 2021-04-14T12:04:35.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4de12fc1-bd53-4c06-b513-2c31ff4542cb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:35.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4de12fc1-bd53-4c06-b513-2c31ff4542cb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:36.245Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d0842d89-3d58-4479-8385-bea03e101cf7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:04:36.245285Z InvocationID=e9cedd3b-b457-433a-bdc1-54c06cba18fe LogTimestamp=2021-04-14T12:04:36.245389Z Entering 2021-04-14T12:04:36.246Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d0842d89-3d58-4479-8385-bea03e101cf7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:04:36.245285Z InvocationID=e9cedd3b-b457-433a-bdc1-54c06cba18fe LogTimestamp=2021-04-14T12:04:36.245389Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:04:36.248Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:04:36.246Z InvocationID=3d81b2dc-1c36-4977-a097-5a2bd3c9f8fb LogTimestamp=2021-04-14T12:04:36.248144Z ResponseDesc=OK Exiting. 2021-04-14T12:04:36.248Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:04:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d85d6055-2935-49fc-9185-9ec65cd68abb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d85d6055-2935-49fc-9185-9ec65cd68abb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@532245f9 2021-04-14T12:04:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d85d6055-2935-49fc-9185-9ec65cd68abb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d85d6055-2935-49fc-9185-9ec65cd68abb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:41.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ecaf39e-2298-4feb-bece-285967e4dfd8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:41.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ecaf39e-2298-4feb-bece-285967e4dfd8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@761328ad 2021-04-14T12:04:41.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ecaf39e-2298-4feb-bece-285967e4dfd8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:41.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ecaf39e-2298-4feb-bece-285967e4dfd8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:44.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f49c27-24e2-443b-9dc7-757c1e72c3f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:44.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f49c27-24e2-443b-9dc7-757c1e72c3f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bd8098b 2021-04-14T12:04:44.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f49c27-24e2-443b-9dc7-757c1e72c3f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:44.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=51f49c27-24e2-443b-9dc7-757c1e72c3f1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:04:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:04:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dca59f-8f4d-4347-ae55-1e66a9abb75e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dca59f-8f4d-4347-ae55-1e66a9abb75e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bb196f2 2021-04-14T12:04:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dca59f-8f4d-4347-ae55-1e66a9abb75e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dca59f-8f4d-4347-ae55-1e66a9abb75e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29ad38-77ec-475e-961a-6aae066aa9b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29ad38-77ec-475e-961a-6aae066aa9b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6afd13f0 2021-04-14T12:04:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29ad38-77ec-475e-961a-6aae066aa9b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a29ad38-77ec-475e-961a-6aae066aa9b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:54.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee173b7c-1fab-4eae-b7dd-391ac737745f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:54.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee173b7c-1fab-4eae-b7dd-391ac737745f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c40842 2021-04-14T12:04:54.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee173b7c-1fab-4eae-b7dd-391ac737745f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:54.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee173b7c-1fab-4eae-b7dd-391ac737745f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b00a4d-0e56-4493-9151-2426f99c07dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b00a4d-0e56-4493-9151-2426f99c07dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ebbcd20 2021-04-14T12:04:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b00a4d-0e56-4493-9151-2426f99c07dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b00a4d-0e56-4493-9151-2426f99c07dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:04:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ca5248b-a1ba-4429-85fb-1f5c0b4d4196 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:04:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ca5248b-a1ba-4429-85fb-1f5c0b4d4196 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@491ad003 2021-04-14T12:04:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ca5248b-a1ba-4429-85fb-1f5c0b4d4196 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:04:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ca5248b-a1ba-4429-85fb-1f5c0b4d4196 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa74d9f3-0399-4b7d-9284-e3bdd4260fb9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa74d9f3-0399-4b7d-9284-e3bdd4260fb9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bfa2843 2021-04-14T12:05:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa74d9f3-0399-4b7d-9284-e3bdd4260fb9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fa74d9f3-0399-4b7d-9284-e3bdd4260fb9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:05:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:05:04.350Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:05:04.350Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:05:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:05:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:05:06.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=438cc060-71f0-4e52-a4c1-342c10cb93e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:06.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=438cc060-71f0-4e52-a4c1-342c10cb93e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e59af66 2021-04-14T12:05:06.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=438cc060-71f0-4e52-a4c1-342c10cb93e7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:06.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=438cc060-71f0-4e52-a4c1-342c10cb93e7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:06.269Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9dab6949-0888-4e02-86e9-e2e8a82df729 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:05:06.268883Z InvocationID=f10afb57-6ce6-4bee-a3aa-76fe304ddfb3 LogTimestamp=2021-04-14T12:05:06.268934Z Entering 2021-04-14T12:05:06.269Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9dab6949-0888-4e02-86e9-e2e8a82df729 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:05:06.268883Z InvocationID=f10afb57-6ce6-4bee-a3aa-76fe304ddfb3 LogTimestamp=2021-04-14T12:05:06.268934Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:05:06.270Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:05:06.269Z InvocationID=3680d5fc-af6b-4cc7-a99b-a0d2bcec89e0 LogTimestamp=2021-04-14T12:05:06.270699Z ResponseDesc=OK Exiting. 2021-04-14T12:05:06.271Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:05:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6134dffc-e2e6-4ba6-8125-3d299fca66ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6134dffc-e2e6-4ba6-8125-3d299fca66ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ebbad40 2021-04-14T12:05:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6134dffc-e2e6-4ba6-8125-3d299fca66ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6134dffc-e2e6-4ba6-8125-3d299fca66ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:11.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=225ee931-37c5-4471-b682-7a6a44f3cd04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:11.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=225ee931-37c5-4471-b682-7a6a44f3cd04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41bee45c 2021-04-14T12:05:11.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=225ee931-37c5-4471-b682-7a6a44f3cd04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:11.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=225ee931-37c5-4471-b682-7a6a44f3cd04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e952a72-7c70-4412-97dc-a07beb0e24fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e952a72-7c70-4412-97dc-a07beb0e24fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b1c6418 2021-04-14T12:05:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e952a72-7c70-4412-97dc-a07beb0e24fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e952a72-7c70-4412-97dc-a07beb0e24fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:17.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f866fa7-faca-4938-b4af-5baccd5db435 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:17.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f866fa7-faca-4938-b4af-5baccd5db435 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@781dd282 2021-04-14T12:05:17.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f866fa7-faca-4938-b4af-5baccd5db435 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:17.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f866fa7-faca-4938-b4af-5baccd5db435 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a933e5ae-4556-4203-87dc-db68805b78bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a933e5ae-4556-4203-87dc-db68805b78bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bcfa16c 2021-04-14T12:05:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a933e5ae-4556-4203-87dc-db68805b78bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a933e5ae-4556-4203-87dc-db68805b78bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac76c3f4-a7a1-4bd1-b033-c325fa709185 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac76c3f4-a7a1-4bd1-b033-c325fa709185 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4de5364d 2021-04-14T12:05:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac76c3f4-a7a1-4bd1-b033-c325fa709185 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac76c3f4-a7a1-4bd1-b033-c325fa709185 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:27.194Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d0fd5ef-84b0-4f05-bd78-864786aecabd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:27.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d0fd5ef-84b0-4f05-bd78-864786aecabd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7561b74d 2021-04-14T12:05:27.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d0fd5ef-84b0-4f05-bd78-864786aecabd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:27.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d0fd5ef-84b0-4f05-bd78-864786aecabd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02193a4d-420a-4f81-bdd4-9a9345b18483 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02193a4d-420a-4f81-bdd4-9a9345b18483 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@637ef2a1 2021-04-14T12:05:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02193a4d-420a-4f81-bdd4-9a9345b18483 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02193a4d-420a-4f81-bdd4-9a9345b18483 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:31.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:31.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:31.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1f0310-e145-4767-91c7-0cbb6b081189 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1f0310-e145-4767-91c7-0cbb6b081189 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65bceb63 2021-04-14T12:05:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1f0310-e145-4767-91c7-0cbb6b081189 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d1f0310-e145-4767-91c7-0cbb6b081189 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:35.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176923fc-add5-40e3-89d2-8c7a42e7da73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:35.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176923fc-add5-40e3-89d2-8c7a42e7da73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10ffec7 2021-04-14T12:05:35.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176923fc-add5-40e3-89d2-8c7a42e7da73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:35.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176923fc-add5-40e3-89d2-8c7a42e7da73 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:36.239Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2f8980a8-7bde-4f4e-97fa-635351397268 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:05:36.239056Z InvocationID=7921a5fe-5da0-4148-912a-accc10b8be05 LogTimestamp=2021-04-14T12:05:36.239192Z Entering 2021-04-14T12:05:36.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2f8980a8-7bde-4f4e-97fa-635351397268 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:05:36.239056Z InvocationID=7921a5fe-5da0-4148-912a-accc10b8be05 LogTimestamp=2021-04-14T12:05:36.239192Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:05:36.242Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:05:36.240Z InvocationID=5eea486f-40b6-4b49-af48-07eae28413ee LogTimestamp=2021-04-14T12:05:36.242655Z ResponseDesc=OK Exiting. 2021-04-14T12:05:36.243Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:05:39.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=958ecb7b-27be-42f7-96ba-0638e1bda69d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:39.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=958ecb7b-27be-42f7-96ba-0638e1bda69d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79acfa74 2021-04-14T12:05:39.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=958ecb7b-27be-42f7-96ba-0638e1bda69d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:39.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=958ecb7b-27be-42f7-96ba-0638e1bda69d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:41.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6051597e-45b6-4265-a38a-35e1d84748f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:41.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6051597e-45b6-4265-a38a-35e1d84748f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d53e41a 2021-04-14T12:05:41.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6051597e-45b6-4265-a38a-35e1d84748f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:41.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6051597e-45b6-4265-a38a-35e1d84748f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:44.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94598dd2-dd65-4006-aeeb-1fd76cbbe994 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:44.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94598dd2-dd65-4006-aeeb-1fd76cbbe994 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb6fd20 2021-04-14T12:05:44.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94598dd2-dd65-4006-aeeb-1fd76cbbe994 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:44.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94598dd2-dd65-4006-aeeb-1fd76cbbe994 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:05:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:05:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f6ac4c5-acbd-42ff-9ec2-904d9e5176d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f6ac4c5-acbd-42ff-9ec2-904d9e5176d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1131cfd7 2021-04-14T12:05:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f6ac4c5-acbd-42ff-9ec2-904d9e5176d6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f6ac4c5-acbd-42ff-9ec2-904d9e5176d6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:48.225Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=10d1dfd4-ab7d-42fb-8983-ad46c8e83719 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:05:48.223992Z InvocationID=1231e169-6bc2-4ea3-bcdd-818a0e653fcd LogTimestamp=2021-04-14T12:05:48.224069Z Entering 2021-04-14T12:05:48.225Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=10d1dfd4-ab7d-42fb-8983-ad46c8e83719 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:05:48.223992Z InvocationID=1231e169-6bc2-4ea3-bcdd-818a0e653fcd LogTimestamp=2021-04-14T12:05:48.224069Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:05:48.227Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:05:48.225Z InvocationID=58aebebc-3c19-4691-8835-29bf93cfd9b8 LogTimestamp=2021-04-14T12:05:48.227022Z ResponseDesc=OK Exiting. 2021-04-14T12:05:48.227Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:05:51.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c734d2b3-5195-43ca-a23f-8ac797a2eaeb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:51.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c734d2b3-5195-43ca-a23f-8ac797a2eaeb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f50e8df 2021-04-14T12:05:51.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c734d2b3-5195-43ca-a23f-8ac797a2eaeb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:51.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c734d2b3-5195-43ca-a23f-8ac797a2eaeb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:53.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73a082e4-7e72-4176-b996-5aafddb0d75a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:53.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73a082e4-7e72-4176-b996-5aafddb0d75a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7dd1ae1b 2021-04-14T12:05:53.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73a082e4-7e72-4176-b996-5aafddb0d75a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:53.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73a082e4-7e72-4176-b996-5aafddb0d75a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:56.808Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7d4634-715a-4494-97d2-967e59defcf7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:56.808Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7d4634-715a-4494-97d2-967e59defcf7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2556137c 2021-04-14T12:05:56.808Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7d4634-715a-4494-97d2-967e59defcf7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:56.808Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b7d4634-715a-4494-97d2-967e59defcf7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:05:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7beecc1b-126b-4e1c-9a0a-d6759aa5497a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:05:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7beecc1b-126b-4e1c-9a0a-d6759aa5497a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a862f76 2021-04-14T12:05:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7beecc1b-126b-4e1c-9a0a-d6759aa5497a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:05:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7beecc1b-126b-4e1c-9a0a-d6759aa5497a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:02.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74bc7c3d-8dfd-4bdc-ad48-bbbb86879a5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:02.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74bc7c3d-8dfd-4bdc-ad48-bbbb86879a5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32183ee9 2021-04-14T12:06:02.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74bc7c3d-8dfd-4bdc-ad48-bbbb86879a5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:02.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74bc7c3d-8dfd-4bdc-ad48-bbbb86879a5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:06:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:06:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:06:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:06:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:06:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:06:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e6b5140-9fb3-4c7e-b845-b5f7850fbb37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e6b5140-9fb3-4c7e-b845-b5f7850fbb37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42c9efc7 2021-04-14T12:06:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e6b5140-9fb3-4c7e-b845-b5f7850fbb37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e6b5140-9fb3-4c7e-b845-b5f7850fbb37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:06.243Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=47d3d7b1-6ee8-4e0c-a0dc-c1ff51c332c1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:06:06.242935Z InvocationID=fb15d1fd-4d13-427b-afa3-1202611b4656 LogTimestamp=2021-04-14T12:06:06.242987Z Entering 2021-04-14T12:06:06.243Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=47d3d7b1-6ee8-4e0c-a0dc-c1ff51c332c1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:06:06.242935Z InvocationID=fb15d1fd-4d13-427b-afa3-1202611b4656 LogTimestamp=2021-04-14T12:06:06.242987Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:06:06.244Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:06:06.243Z InvocationID=891d76e7-408d-4f9b-b62a-72eca21abe96 LogTimestamp=2021-04-14T12:06:06.244698Z ResponseDesc=OK Exiting. 2021-04-14T12:06:06.245Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:06:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbcc9227-990c-4c7a-8e20-6fd32977307c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbcc9227-990c-4c7a-8e20-6fd32977307c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5791d911 2021-04-14T12:06:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbcc9227-990c-4c7a-8e20-6fd32977307c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbcc9227-990c-4c7a-8e20-6fd32977307c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d9844ca-fc22-41eb-8430-32962f466666 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d9844ca-fc22-41eb-8430-32962f466666 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ce7a10a 2021-04-14T12:06:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d9844ca-fc22-41eb-8430-32962f466666 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d9844ca-fc22-41eb-8430-32962f466666 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:14.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1dc1c5-d0ff-4dec-a9a9-b204dd53f2ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:14.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1dc1c5-d0ff-4dec-a9a9-b204dd53f2ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ffb3309 2021-04-14T12:06:14.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1dc1c5-d0ff-4dec-a9a9-b204dd53f2ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:14.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e1dc1c5-d0ff-4dec-a9a9-b204dd53f2ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:17.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3e5b386-fbd8-4371-a463-5946c7e502de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:17.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3e5b386-fbd8-4371-a463-5946c7e502de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@224146e6 2021-04-14T12:06:17.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3e5b386-fbd8-4371-a463-5946c7e502de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:17.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3e5b386-fbd8-4371-a463-5946c7e502de PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa88b28c-5033-4fa8-9191-9816c9d2d5ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa88b28c-5033-4fa8-9191-9816c9d2d5ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b415aee 2021-04-14T12:06:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa88b28c-5033-4fa8-9191-9816c9d2d5ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa88b28c-5033-4fa8-9191-9816c9d2d5ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:24.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfdb730b-0049-4023-abcf-fa975a93bc66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:24.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfdb730b-0049-4023-abcf-fa975a93bc66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1acf5b7d 2021-04-14T12:06:24.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfdb730b-0049-4023-abcf-fa975a93bc66 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:24.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfdb730b-0049-4023-abcf-fa975a93bc66 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ecfc79-7577-4e03-b652-da792b0c3065 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ecfc79-7577-4e03-b652-da792b0c3065 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cda5056 2021-04-14T12:06:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ecfc79-7577-4e03-b652-da792b0c3065 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ecfc79-7577-4e03-b652-da792b0c3065 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b750815-9b97-4c56-8e97-c9b1b7838594 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b750815-9b97-4c56-8e97-c9b1b7838594 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44044d5d 2021-04-14T12:06:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b750815-9b97-4c56-8e97-c9b1b7838594 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b750815-9b97-4c56-8e97-c9b1b7838594 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:33.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7bdfe0-418c-48c7-a3ab-5af0f7eabfdd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:33.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7bdfe0-418c-48c7-a3ab-5af0f7eabfdd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3563f919 2021-04-14T12:06:33.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7bdfe0-418c-48c7-a3ab-5af0f7eabfdd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:33.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d7bdfe0-418c-48c7-a3ab-5af0f7eabfdd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:35.797Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b57453f9-43fa-4e91-bb69-5b7d64ca4771 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:35.797Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b57453f9-43fa-4e91-bb69-5b7d64ca4771 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5597487b 2021-04-14T12:06:35.797Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b57453f9-43fa-4e91-bb69-5b7d64ca4771 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:35.797Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b57453f9-43fa-4e91-bb69-5b7d64ca4771 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:36.238Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8fb7eb0d-4170-492b-b125-d8b10ac83807 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:06:36.238295Z InvocationID=4b5f50f5-1e30-4342-8441-0e99a5e4d6ca LogTimestamp=2021-04-14T12:06:36.238415Z Entering 2021-04-14T12:06:36.239Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8fb7eb0d-4170-492b-b125-d8b10ac83807 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:06:36.238295Z InvocationID=4b5f50f5-1e30-4342-8441-0e99a5e4d6ca LogTimestamp=2021-04-14T12:06:36.238415Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:06:36.240Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:06:36.239Z InvocationID=9191a904-4f10-4535-8120-c5f422e49e52 LogTimestamp=2021-04-14T12:06:36.240857Z ResponseDesc=OK Exiting. 2021-04-14T12:06:36.241Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:06:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df17b2a1-a1e5-4345-a30d-8771311ad10d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df17b2a1-a1e5-4345-a30d-8771311ad10d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bf1fa7f 2021-04-14T12:06:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df17b2a1-a1e5-4345-a30d-8771311ad10d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df17b2a1-a1e5-4345-a30d-8771311ad10d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e706aa3a-b90b-474c-b9c1-d111ba2f1517 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e706aa3a-b90b-474c-b9c1-d111ba2f1517 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@df93cf9 2021-04-14T12:06:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e706aa3a-b90b-474c-b9c1-d111ba2f1517 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e706aa3a-b90b-474c-b9c1-d111ba2f1517 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e009661-7cbf-4905-87a3-fb9921167bfa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e009661-7cbf-4905-87a3-fb9921167bfa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27f8a76e 2021-04-14T12:06:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e009661-7cbf-4905-87a3-fb9921167bfa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e009661-7cbf-4905-87a3-fb9921167bfa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:06:46.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:06:47.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1b95e1-5c3f-4d19-a029-070d3e5d4598 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:47.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1b95e1-5c3f-4d19-a029-070d3e5d4598 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48c3f77a 2021-04-14T12:06:47.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1b95e1-5c3f-4d19-a029-070d3e5d4598 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:47.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1b95e1-5c3f-4d19-a029-070d3e5d4598 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:51.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e034fbbc-b393-4e5f-af2c-512946182511 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:51.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e034fbbc-b393-4e5f-af2c-512946182511 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c05de1f 2021-04-14T12:06:51.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e034fbbc-b393-4e5f-af2c-512946182511 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:51.337Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e034fbbc-b393-4e5f-af2c-512946182511 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:53.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2384b6d-d2bb-4114-b72d-2d440855a626 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:53.969Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2384b6d-d2bb-4114-b72d-2d440855a626 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68df2192 2021-04-14T12:06:53.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2384b6d-d2bb-4114-b72d-2d440855a626 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:53.970Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2384b6d-d2bb-4114-b72d-2d440855a626 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:56.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10bdb40-7c7b-454b-a65c-4d24af78664e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:56.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10bdb40-7c7b-454b-a65c-4d24af78664e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a7e3830 2021-04-14T12:06:56.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10bdb40-7c7b-454b-a65c-4d24af78664e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:56.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e10bdb40-7c7b-454b-a65c-4d24af78664e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:06:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99a7a60b-b88d-4500-a11f-d5ae4675b758 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:06:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99a7a60b-b88d-4500-a11f-d5ae4675b758 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d516622 2021-04-14T12:06:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99a7a60b-b88d-4500-a11f-d5ae4675b758 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:06:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99a7a60b-b88d-4500-a11f-d5ae4675b758 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:02.721Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cffdc0-105b-4bfc-bfc4-a28c6e369a12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:02.721Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cffdc0-105b-4bfc-bfc4-a28c6e369a12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f26beb1 2021-04-14T12:07:02.721Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cffdc0-105b-4bfc-bfc4-a28c6e369a12 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:02.721Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6cffdc0-105b-4bfc-bfc4-a28c6e369a12 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:07:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:07:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:07:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:07:04.357Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:07:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:07:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9bf29cb-c387-42f4-a8c2-93208a312cb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9bf29cb-c387-42f4-a8c2-93208a312cb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e64c776 2021-04-14T12:07:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9bf29cb-c387-42f4-a8c2-93208a312cb7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9bf29cb-c387-42f4-a8c2-93208a312cb7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:06.255Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=285fdd1e-be63-499b-a78e-00a3dbd103f2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:07:06.254512Z InvocationID=a0aecdc6-bd26-4568-b2f7-8a7e0e2c4a14 LogTimestamp=2021-04-14T12:07:06.254592Z Entering 2021-04-14T12:07:06.255Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=285fdd1e-be63-499b-a78e-00a3dbd103f2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:07:06.254512Z InvocationID=a0aecdc6-bd26-4568-b2f7-8a7e0e2c4a14 LogTimestamp=2021-04-14T12:07:06.254592Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:07:06.257Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:07:06.255Z InvocationID=f0ca1602-6ef2-4dda-ac4e-95ece3e0bdd7 LogTimestamp=2021-04-14T12:07:06.257499Z ResponseDesc=OK Exiting. 2021-04-14T12:07:06.257Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:07:09.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb817b2-5587-4d41-83ef-422f2f7456f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:09.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb817b2-5587-4d41-83ef-422f2f7456f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3520c932 2021-04-14T12:07:09.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb817b2-5587-4d41-83ef-422f2f7456f7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:09.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdb817b2-5587-4d41-83ef-422f2f7456f7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ea285ce-2fb2-4963-8d69-6bd1fe92db75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ea285ce-2fb2-4963-8d69-6bd1fe92db75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6396c9c2 2021-04-14T12:07:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ea285ce-2fb2-4963-8d69-6bd1fe92db75 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ea285ce-2fb2-4963-8d69-6bd1fe92db75 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:14.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dabaa883-3be9-4e4a-8b9e-aaf3f6f0bbba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:14.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dabaa883-3be9-4e4a-8b9e-aaf3f6f0bbba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9af2037 2021-04-14T12:07:14.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dabaa883-3be9-4e4a-8b9e-aaf3f6f0bbba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:14.625Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dabaa883-3be9-4e4a-8b9e-aaf3f6f0bbba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dcb4c63-162a-4f29-b2d7-19cbfe51497c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dcb4c63-162a-4f29-b2d7-19cbfe51497c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61981903 2021-04-14T12:07:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dcb4c63-162a-4f29-b2d7-19cbfe51497c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7dcb4c63-162a-4f29-b2d7-19cbfe51497c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65481687-28b6-4c5c-a9f2-54663159e1a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65481687-28b6-4c5c-a9f2-54663159e1a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5242355b 2021-04-14T12:07:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65481687-28b6-4c5c-a9f2-54663159e1a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65481687-28b6-4c5c-a9f2-54663159e1a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:24.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3bbf94b-26c4-4866-9f6a-df097d69e6fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:24.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3bbf94b-26c4-4866-9f6a-df097d69e6fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74f3e08 2021-04-14T12:07:24.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3bbf94b-26c4-4866-9f6a-df097d69e6fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:24.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3bbf94b-26c4-4866-9f6a-df097d69e6fe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50918d41-1cdd-423d-a15b-cd51e6bb4d91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50918d41-1cdd-423d-a15b-cd51e6bb4d91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7711184e 2021-04-14T12:07:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50918d41-1cdd-423d-a15b-cd51e6bb4d91 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50918d41-1cdd-423d-a15b-cd51e6bb4d91 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:29.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e6ac88-d980-4b78-8f2b-d3551be1590d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:29.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e6ac88-d980-4b78-8f2b-d3551be1590d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@566047ae 2021-04-14T12:07:29.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e6ac88-d980-4b78-8f2b-d3551be1590d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:29.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e6ac88-d980-4b78-8f2b-d3551be1590d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952c95bd-e000-4f83-b15a-2f15116c2663 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952c95bd-e000-4f83-b15a-2f15116c2663 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15cb48d4 2021-04-14T12:07:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952c95bd-e000-4f83-b15a-2f15116c2663 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:33.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=952c95bd-e000-4f83-b15a-2f15116c2663 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:35.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a5c40b9-a62a-4c36-9d3b-695e9d70c2ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:35.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a5c40b9-a62a-4c36-9d3b-695e9d70c2ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b8a8b1b 2021-04-14T12:07:35.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a5c40b9-a62a-4c36-9d3b-695e9d70c2ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:35.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a5c40b9-a62a-4c36-9d3b-695e9d70c2ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:36.230Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2feff331-d2d5-45f6-892c-03016ca65bfc InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:07:36.230574Z InvocationID=e68f46a9-6052-4356-8de2-b9f31129239f LogTimestamp=2021-04-14T12:07:36.230647Z Entering 2021-04-14T12:07:36.231Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2feff331-d2d5-45f6-892c-03016ca65bfc InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:07:36.230574Z InvocationID=e68f46a9-6052-4356-8de2-b9f31129239f LogTimestamp=2021-04-14T12:07:36.230647Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:07:36.232Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:07:36.231Z InvocationID=a18d7b42-8714-4b40-a0b2-e7d5d9e98cb6 LogTimestamp=2021-04-14T12:07:36.232664Z ResponseDesc=OK Exiting. 2021-04-14T12:07:36.233Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:07:39.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da4f10a-4db4-4486-bfd6-79b783c80955 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:39.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da4f10a-4db4-4486-bfd6-79b783c80955 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14a62d4c 2021-04-14T12:07:39.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da4f10a-4db4-4486-bfd6-79b783c80955 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:39.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da4f10a-4db4-4486-bfd6-79b783c80955 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:41.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a6f4214-4b0d-4873-8015-d1bbfcf1c2d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:41.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a6f4214-4b0d-4873-8015-d1bbfcf1c2d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40af4541 2021-04-14T12:07:41.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a6f4214-4b0d-4873-8015-d1bbfcf1c2d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:41.574Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a6f4214-4b0d-4873-8015-d1bbfcf1c2d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668dde22-9bd7-40a1-b49e-57dcd8aabb81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668dde22-9bd7-40a1-b49e-57dcd8aabb81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f6d2868 2021-04-14T12:07:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668dde22-9bd7-40a1-b49e-57dcd8aabb81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:45.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668dde22-9bd7-40a1-b49e-57dcd8aabb81 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:07:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:07:48.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=158b8450-5295-4131-8947-cab3b1917552 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:48.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=158b8450-5295-4131-8947-cab3b1917552 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3000a8cd 2021-04-14T12:07:48.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=158b8450-5295-4131-8947-cab3b1917552 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:48.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=158b8450-5295-4131-8947-cab3b1917552 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:48.233Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d54d895a-c823-4daf-9c3e-540273808627 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:07:48.233182Z InvocationID=1425b491-1391-455c-ae60-1a52b6820901 LogTimestamp=2021-04-14T12:07:48.233270Z Entering 2021-04-14T12:07:48.233Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d54d895a-c823-4daf-9c3e-540273808627 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:07:48.233182Z InvocationID=1425b491-1391-455c-ae60-1a52b6820901 LogTimestamp=2021-04-14T12:07:48.233270Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:07:48.235Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:07:48.234Z InvocationID=ee694397-182c-4c5f-b567-83e1b7011213 LogTimestamp=2021-04-14T12:07:48.235301Z ResponseDesc=OK Exiting. 2021-04-14T12:07:48.235Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:07:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0323f369-5400-4fd7-9e2e-8282b84c13e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0323f369-5400-4fd7-9e2e-8282b84c13e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15e93fcc 2021-04-14T12:07:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0323f369-5400-4fd7-9e2e-8282b84c13e7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0323f369-5400-4fd7-9e2e-8282b84c13e7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:53.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8a7e5f-e1f2-4224-a830-84f4fd169c01 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:53.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8a7e5f-e1f2-4224-a830-84f4fd169c01 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f56e57d 2021-04-14T12:07:53.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8a7e5f-e1f2-4224-a830-84f4fd169c01 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:53.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8a7e5f-e1f2-4224-a830-84f4fd169c01 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:57.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d59ca8-3e3f-4d87-ab3b-81640149864a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:57.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d59ca8-3e3f-4d87-ab3b-81640149864a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@491eb697 2021-04-14T12:07:57.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d59ca8-3e3f-4d87-ab3b-81640149864a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:57.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39d59ca8-3e3f-4d87-ab3b-81640149864a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:07:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e2525da-1bc8-4d65-9cd3-9a05f7896c5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:07:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e2525da-1bc8-4d65-9cd3-9a05f7896c5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ced29b9 2021-04-14T12:07:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e2525da-1bc8-4d65-9cd3-9a05f7896c5c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:07:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e2525da-1bc8-4d65-9cd3-9a05f7896c5c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a83174c-8960-4d67-9ef9-e22deacc69c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a83174c-8960-4d67-9ef9-e22deacc69c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20266eb7 2021-04-14T12:08:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a83174c-8960-4d67-9ef9-e22deacc69c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:02.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a83174c-8960-4d67-9ef9-e22deacc69c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:08:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:08:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:08:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:08:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:08:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:08:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65cb809-4c6d-45c4-acd9-69957a61c7c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65cb809-4c6d-45c4-acd9-69957a61c7c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38430ac3 2021-04-14T12:08:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65cb809-4c6d-45c4-acd9-69957a61c7c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b65cb809-4c6d-45c4-acd9-69957a61c7c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:06.239Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=700edfef-b74a-4382-be9f-15e8b78d4019 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:08:06.238650Z InvocationID=8c020419-99e6-4abe-8859-e2877f617340 LogTimestamp=2021-04-14T12:08:06.238700Z Entering 2021-04-14T12:08:06.239Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=700edfef-b74a-4382-be9f-15e8b78d4019 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:08:06.238650Z InvocationID=8c020419-99e6-4abe-8859-e2877f617340 LogTimestamp=2021-04-14T12:08:06.238700Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:08:06.242Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:08:06.239Z InvocationID=9d9ca5a4-575e-43ba-900d-4ff3e5740dbc LogTimestamp=2021-04-14T12:08:06.242218Z ResponseDesc=OK Exiting. 2021-04-14T12:08:06.242Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:08:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b8ddbad-6555-4386-9e64-7c71324e2487 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b8ddbad-6555-4386-9e64-7c71324e2487 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d5b952 2021-04-14T12:08:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b8ddbad-6555-4386-9e64-7c71324e2487 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b8ddbad-6555-4386-9e64-7c71324e2487 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:12.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1173cedc-5eb3-41d8-9eb1-2851c2c937ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1173cedc-5eb3-41d8-9eb1-2851c2c937ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1160e890 2021-04-14T12:08:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1173cedc-5eb3-41d8-9eb1-2851c2c937ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:12.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1173cedc-5eb3-41d8-9eb1-2851c2c937ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbced3c-6a2b-4de2-a9ea-fd16c24462aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:14.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbced3c-6a2b-4de2-a9ea-fd16c24462aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a07fdd 2021-04-14T12:08:14.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbced3c-6a2b-4de2-a9ea-fd16c24462aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:14.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bbced3c-6a2b-4de2-a9ea-fd16c24462aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:17.797Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff77f5b4-9aaf-4416-ba98-4a917f295a5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:17.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff77f5b4-9aaf-4416-ba98-4a917f295a5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22157858 2021-04-14T12:08:17.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff77f5b4-9aaf-4416-ba98-4a917f295a5b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:17.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff77f5b4-9aaf-4416-ba98-4a917f295a5b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79958d8-8348-4b92-8d7c-460d13fe8bc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79958d8-8348-4b92-8d7c-460d13fe8bc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b235a61 2021-04-14T12:08:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79958d8-8348-4b92-8d7c-460d13fe8bc5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e79958d8-8348-4b92-8d7c-460d13fe8bc5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:23.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bea364-b929-4946-af53-0c298351ee97 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:23.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bea364-b929-4946-af53-0c298351ee97 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d9107fd 2021-04-14T12:08:23.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bea364-b929-4946-af53-0c298351ee97 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:23.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bea364-b929-4946-af53-0c298351ee97 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:27.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f2c2241-b8b8-4320-88fc-a6ddf5c0876d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:27.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f2c2241-b8b8-4320-88fc-a6ddf5c0876d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ccecd05 2021-04-14T12:08:27.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f2c2241-b8b8-4320-88fc-a6ddf5c0876d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:27.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f2c2241-b8b8-4320-88fc-a6ddf5c0876d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:29.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308f69d2-d6cd-4ac0-81b3-3c61cc4bad92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:29.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308f69d2-d6cd-4ac0-81b3-3c61cc4bad92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1510a17c 2021-04-14T12:08:29.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308f69d2-d6cd-4ac0-81b3-3c61cc4bad92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:29.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308f69d2-d6cd-4ac0-81b3-3c61cc4bad92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a69390fb-17e1-4803-b6eb-32b6980ccfad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a69390fb-17e1-4803-b6eb-32b6980ccfad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47101ed 2021-04-14T12:08:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a69390fb-17e1-4803-b6eb-32b6980ccfad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a69390fb-17e1-4803-b6eb-32b6980ccfad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfc1d58-f7b7-4973-bbf0-cbe5aa2c467a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfc1d58-f7b7-4973-bbf0-cbe5aa2c467a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@114a5071 2021-04-14T12:08:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfc1d58-f7b7-4973-bbf0-cbe5aa2c467a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdfc1d58-f7b7-4973-bbf0-cbe5aa2c467a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:36.252Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bdee710f-3cd9-43b0-98dc-5078d682368c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:08:36.252147Z InvocationID=bf65c306-6bec-4e08-8333-518b68d00e97 LogTimestamp=2021-04-14T12:08:36.252311Z Entering 2021-04-14T12:08:36.252Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bdee710f-3cd9-43b0-98dc-5078d682368c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:08:36.252147Z InvocationID=bf65c306-6bec-4e08-8333-518b68d00e97 LogTimestamp=2021-04-14T12:08:36.252311Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:08:36.254Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:08:36.253Z InvocationID=20713d00-982a-4c32-991c-77019854fed7 LogTimestamp=2021-04-14T12:08:36.254352Z ResponseDesc=OK Exiting. 2021-04-14T12:08:36.254Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:08:38.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeb1ff8-653d-4cb9-b2e8-8f61f2374374 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:38.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeb1ff8-653d-4cb9-b2e8-8f61f2374374 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b8611b8 2021-04-14T12:08:38.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeb1ff8-653d-4cb9-b2e8-8f61f2374374 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:38.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaeb1ff8-653d-4cb9-b2e8-8f61f2374374 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:41.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b52e3-912c-4413-9efb-9a3d2f1f7e61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:41.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b52e3-912c-4413-9efb-9a3d2f1f7e61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b0d44f5 2021-04-14T12:08:41.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b52e3-912c-4413-9efb-9a3d2f1f7e61 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:41.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b52e3-912c-4413-9efb-9a3d2f1f7e61 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d09f783-0e8b-447e-bd27-3f87fbe5a054 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d09f783-0e8b-447e-bd27-3f87fbe5a054 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@677f4e10 2021-04-14T12:08:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d09f783-0e8b-447e-bd27-3f87fbe5a054 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d09f783-0e8b-447e-bd27-3f87fbe5a054 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:08:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:08:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d18e34c8-11ce-4b01-a2ed-44210f408249 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d18e34c8-11ce-4b01-a2ed-44210f408249 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24f54356 2021-04-14T12:08:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d18e34c8-11ce-4b01-a2ed-44210f408249 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d18e34c8-11ce-4b01-a2ed-44210f408249 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd66e61b-2465-482d-b43e-1ffe48dee6a8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd66e61b-2465-482d-b43e-1ffe48dee6a8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb58da1 2021-04-14T12:08:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd66e61b-2465-482d-b43e-1ffe48dee6a8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:51.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd66e61b-2465-482d-b43e-1ffe48dee6a8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:53.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee1cdde-c3dc-4db9-bdce-723fcaefa515 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:53.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee1cdde-c3dc-4db9-bdce-723fcaefa515 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e1e564e 2021-04-14T12:08:53.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee1cdde-c3dc-4db9-bdce-723fcaefa515 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:53.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee1cdde-c3dc-4db9-bdce-723fcaefa515 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:56.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9fc35e9-a8f9-40f0-9f15-bc6a00aefb73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:56.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9fc35e9-a8f9-40f0-9f15-bc6a00aefb73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@730c9a53 2021-04-14T12:08:56.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9fc35e9-a8f9-40f0-9f15-bc6a00aefb73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:56.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9fc35e9-a8f9-40f0-9f15-bc6a00aefb73 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:08:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0b87056-4a62-4132-a8d2-c5a051ac675f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:08:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0b87056-4a62-4132-a8d2-c5a051ac675f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ded8897 2021-04-14T12:08:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0b87056-4a62-4132-a8d2-c5a051ac675f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:08:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0b87056-4a62-4132-a8d2-c5a051ac675f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b7d0a6-8443-428f-9d1f-8d4ce0bb8ec4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b7d0a6-8443-428f-9d1f-8d4ce0bb8ec4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e76da0e 2021-04-14T12:09:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b7d0a6-8443-428f-9d1f-8d4ce0bb8ec4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b7d0a6-8443-428f-9d1f-8d4ce0bb8ec4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:09:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:09:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:09:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:09:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:09:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:09:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03327cda-793f-4a39-885d-0aec0964b98d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03327cda-793f-4a39-885d-0aec0964b98d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@224657a8 2021-04-14T12:09:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03327cda-793f-4a39-885d-0aec0964b98d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03327cda-793f-4a39-885d-0aec0964b98d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:06.239Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f39fd17c-b005-4bd4-94d0-28912903293c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:09:06.239325Z InvocationID=008c6942-8b41-47f4-a4a2-69502748b51f LogTimestamp=2021-04-14T12:09:06.239417Z Entering 2021-04-14T12:09:06.240Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f39fd17c-b005-4bd4-94d0-28912903293c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:09:06.239325Z InvocationID=008c6942-8b41-47f4-a4a2-69502748b51f LogTimestamp=2021-04-14T12:09:06.239417Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:09:06.243Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:09:06.240Z InvocationID=d4feb697-fcb2-43c6-b6a9-c08b455294c1 LogTimestamp=2021-04-14T12:09:06.242943Z ResponseDesc=OK Exiting. 2021-04-14T12:09:06.243Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:09:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0d3d436-f7aa-41ee-a26b-8ce5151d7f04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0d3d436-f7aa-41ee-a26b-8ce5151d7f04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@358f9fb1 2021-04-14T12:09:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0d3d436-f7aa-41ee-a26b-8ce5151d7f04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0d3d436-f7aa-41ee-a26b-8ce5151d7f04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff546194-0d5a-49d3-a088-7da5b41686b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff546194-0d5a-49d3-a088-7da5b41686b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@243710a7 2021-04-14T12:09:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff546194-0d5a-49d3-a088-7da5b41686b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff546194-0d5a-49d3-a088-7da5b41686b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bca0dd-62b5-479a-b5fc-f520beb23508 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bca0dd-62b5-479a-b5fc-f520beb23508 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c190885 2021-04-14T12:09:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bca0dd-62b5-479a-b5fc-f520beb23508 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65bca0dd-62b5-479a-b5fc-f520beb23508 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:17.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b738551-93cd-4da3-82e7-8be19f31159d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:17.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b738551-93cd-4da3-82e7-8be19f31159d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c72e1b9 2021-04-14T12:09:17.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b738551-93cd-4da3-82e7-8be19f31159d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:17.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b738551-93cd-4da3-82e7-8be19f31159d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:20.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc48659-fda0-48e2-8d1b-c90b4d228976 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:20.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc48659-fda0-48e2-8d1b-c90b4d228976 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75c99391 2021-04-14T12:09:20.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc48659-fda0-48e2-8d1b-c90b4d228976 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:20.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bc48659-fda0-48e2-8d1b-c90b4d228976 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42cc0247-8d7e-40de-8737-935607e131cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42cc0247-8d7e-40de-8737-935607e131cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@696707a7 2021-04-14T12:09:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42cc0247-8d7e-40de-8737-935607e131cd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42cc0247-8d7e-40de-8737-935607e131cd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:26.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8d0ed5-707d-4a98-a0b0-b4605e91ffa3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:26.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8d0ed5-707d-4a98-a0b0-b4605e91ffa3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dde772e 2021-04-14T12:09:26.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8d0ed5-707d-4a98-a0b0-b4605e91ffa3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:26.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8d0ed5-707d-4a98-a0b0-b4605e91ffa3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:30.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26340bce-51e7-41b2-a7ce-d83d64a60329 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26340bce-51e7-41b2-a7ce-d83d64a60329 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@268a3005 2021-04-14T12:09:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26340bce-51e7-41b2-a7ce-d83d64a60329 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26340bce-51e7-41b2-a7ce-d83d64a60329 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:32.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5561fcf4-1e8b-47cd-a160-6eeb2dfa28ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:32.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5561fcf4-1e8b-47cd-a160-6eeb2dfa28ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fe66a5e 2021-04-14T12:09:32.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5561fcf4-1e8b-47cd-a160-6eeb2dfa28ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:32.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5561fcf4-1e8b-47cd-a160-6eeb2dfa28ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d36d59f-3827-43d4-bbd5-d483e974185f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d36d59f-3827-43d4-bbd5-d483e974185f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4eed1c3a 2021-04-14T12:09:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d36d59f-3827-43d4-bbd5-d483e974185f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d36d59f-3827-43d4-bbd5-d483e974185f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:36.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=86eadb9a-9e9d-4db1-ba35-54e2c7abaa47 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:09:36.236054Z InvocationID=0ecbbdb8-753a-459c-b461-7234b98f548f LogTimestamp=2021-04-14T12:09:36.236157Z Entering 2021-04-14T12:09:36.237Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=86eadb9a-9e9d-4db1-ba35-54e2c7abaa47 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:09:36.236054Z InvocationID=0ecbbdb8-753a-459c-b461-7234b98f548f LogTimestamp=2021-04-14T12:09:36.236157Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:09:36.240Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:09:36.237Z InvocationID=c65656c4-4fe5-407d-b70a-da80a246e042 LogTimestamp=2021-04-14T12:09:36.240449Z ResponseDesc=OK Exiting. 2021-04-14T12:09:36.240Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:09:38.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3405631f-4862-4777-8435-5dec58d17ef5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:38.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3405631f-4862-4777-8435-5dec58d17ef5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30f465ce 2021-04-14T12:09:38.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3405631f-4862-4777-8435-5dec58d17ef5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:38.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3405631f-4862-4777-8435-5dec58d17ef5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53a13d-25e8-4007-b940-1bfb9fc52c12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53a13d-25e8-4007-b940-1bfb9fc52c12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@470961cd 2021-04-14T12:09:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53a13d-25e8-4007-b940-1bfb9fc52c12 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d53a13d-25e8-4007-b940-1bfb9fc52c12 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e7b447-7ef4-4e6b-bb38-0bb21112f5b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e7b447-7ef4-4e6b-bb38-0bb21112f5b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b1147e8 2021-04-14T12:09:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e7b447-7ef4-4e6b-bb38-0bb21112f5b4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4e7b447-7ef4-4e6b-bb38-0bb21112f5b4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:09:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:09:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bd28fda-5bd0-42c8-933e-019a8f739d83 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bd28fda-5bd0-42c8-933e-019a8f739d83 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dbb9a7c 2021-04-14T12:09:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bd28fda-5bd0-42c8-933e-019a8f739d83 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bd28fda-5bd0-42c8-933e-019a8f739d83 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:48.242Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2a250c72-f488-44e2-b9a1-b823a9bd33b0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:09:48.242688Z InvocationID=a689926d-bd8e-45ab-801c-9f335354d87b LogTimestamp=2021-04-14T12:09:48.242747Z Entering 2021-04-14T12:09:48.243Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2a250c72-f488-44e2-b9a1-b823a9bd33b0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:09:48.242688Z InvocationID=a689926d-bd8e-45ab-801c-9f335354d87b LogTimestamp=2021-04-14T12:09:48.242747Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:09:48.244Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:09:48.243Z InvocationID=d2a97594-9f2d-497a-8cf6-58025db323d9 LogTimestamp=2021-04-14T12:09:48.243948Z ResponseDesc=OK Exiting. 2021-04-14T12:09:48.244Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:09:51.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e86e356-6c2e-435e-8b7d-018c2d7a198c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:51.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e86e356-6c2e-435e-8b7d-018c2d7a198c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e725c10 2021-04-14T12:09:51.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e86e356-6c2e-435e-8b7d-018c2d7a198c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:51.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e86e356-6c2e-435e-8b7d-018c2d7a198c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:54.109Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bb4fbd-8b4f-4e37-84b9-2d5a878e5189 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:54.109Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bb4fbd-8b4f-4e37-84b9-2d5a878e5189 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5279591a 2021-04-14T12:09:54.109Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bb4fbd-8b4f-4e37-84b9-2d5a878e5189 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:54.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47bb4fbd-8b4f-4e37-84b9-2d5a878e5189 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=570b925f-2c31-4aad-8c0b-fdbac2e877da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=570b925f-2c31-4aad-8c0b-fdbac2e877da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33367aba 2021-04-14T12:09:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=570b925f-2c31-4aad-8c0b-fdbac2e877da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=570b925f-2c31-4aad-8c0b-fdbac2e877da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:09:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db0ec9a-89a6-4b6f-b6ad-71a0ed6c1cb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:09:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db0ec9a-89a6-4b6f-b6ad-71a0ed6c1cb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22cf6eda 2021-04-14T12:09:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db0ec9a-89a6-4b6f-b6ad-71a0ed6c1cb4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:09:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2db0ec9a-89a6-4b6f-b6ad-71a0ed6c1cb4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:02.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d402361-2a15-46df-9e2f-c330b37cfdff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:02.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d402361-2a15-46df-9e2f-c330b37cfdff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e91344f 2021-04-14T12:10:02.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d402361-2a15-46df-9e2f-c330b37cfdff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:02.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d402361-2a15-46df-9e2f-c330b37cfdff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:10:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:10:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:10:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:10:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:10:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:10:06.242Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d0339c0b-3e5f-4f06-96e0-0537d952536b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:10:06.241986Z InvocationID=1d73b210-1f96-4f46-9190-79e1f2b5c98c LogTimestamp=2021-04-14T12:10:06.242033Z Entering 2021-04-14T12:10:06.242Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d0339c0b-3e5f-4f06-96e0-0537d952536b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:10:06.241986Z InvocationID=1d73b210-1f96-4f46-9190-79e1f2b5c98c LogTimestamp=2021-04-14T12:10:06.242033Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:10:06.243Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:10:06.242Z InvocationID=47ba6fdc-79b3-442f-8d64-e6b2d3650b61 LogTimestamp=2021-04-14T12:10:06.243510Z ResponseDesc=OK Exiting. 2021-04-14T12:10:06.243Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:10:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4295743-084c-4c17-9da7-2aa97ad6b66c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4295743-084c-4c17-9da7-2aa97ad6b66c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76b8010e 2021-04-14T12:10:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4295743-084c-4c17-9da7-2aa97ad6b66c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4295743-084c-4c17-9da7-2aa97ad6b66c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:09.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85cfa51b-65d8-493f-906b-d58965f3db3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:09.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85cfa51b-65d8-493f-906b-d58965f3db3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76db56c9 2021-04-14T12:10:09.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85cfa51b-65d8-493f-906b-d58965f3db3e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:09.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85cfa51b-65d8-493f-906b-d58965f3db3e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab021827-c50f-482e-8e2f-f1f5efabe8b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab021827-c50f-482e-8e2f-f1f5efabe8b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fbb5f76 2021-04-14T12:10:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab021827-c50f-482e-8e2f-f1f5efabe8b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab021827-c50f-482e-8e2f-f1f5efabe8b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55d3b89e-d570-4883-97d1-42d042db29b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55d3b89e-d570-4883-97d1-42d042db29b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@486f3582 2021-04-14T12:10:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55d3b89e-d570-4883-97d1-42d042db29b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55d3b89e-d570-4883-97d1-42d042db29b8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:17.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68599ef3-a05f-42f3-a829-b5a6ad939599 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:17.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68599ef3-a05f-42f3-a829-b5a6ad939599 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ee9fdf0 2021-04-14T12:10:17.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68599ef3-a05f-42f3-a829-b5a6ad939599 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:17.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68599ef3-a05f-42f3-a829-b5a6ad939599 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92ebe0e-5270-47ed-9523-303f1ad1773d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92ebe0e-5270-47ed-9523-303f1ad1773d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@522881fa 2021-04-14T12:10:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92ebe0e-5270-47ed-9523-303f1ad1773d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d92ebe0e-5270-47ed-9523-303f1ad1773d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:24.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f4ad70-10cc-4021-9045-ba650a9a1a98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:24.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f4ad70-10cc-4021-9045-ba650a9a1a98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@271d3426 2021-04-14T12:10:24.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f4ad70-10cc-4021-9045-ba650a9a1a98 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:24.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55f4ad70-10cc-4021-9045-ba650a9a1a98 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c980a435-d29a-4da9-bcff-2340e1328504 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c980a435-d29a-4da9-bcff-2340e1328504 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16efc662 2021-04-14T12:10:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c980a435-d29a-4da9-bcff-2340e1328504 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c980a435-d29a-4da9-bcff-2340e1328504 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15018fe0-a71f-4d20-806d-57424f6a076c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15018fe0-a71f-4d20-806d-57424f6a076c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27d8af32 2021-04-14T12:10:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15018fe0-a71f-4d20-806d-57424f6a076c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15018fe0-a71f-4d20-806d-57424f6a076c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:31.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:33.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2263e63-e484-4da6-9941-29c2ebb24488 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:33.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2263e63-e484-4da6-9941-29c2ebb24488 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3169cd62 2021-04-14T12:10:33.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2263e63-e484-4da6-9941-29c2ebb24488 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:33.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2263e63-e484-4da6-9941-29c2ebb24488 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:34.609Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01u3fnu738agiz1txeu2mqcjbas211 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gjskbcohjhyg1unev00875m0o209 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xdivykv2yx64lo7vct3y71k7213 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05s2oogy788shi94v3zy31ytw219 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01khje51yu6sqdlh44pne5s6vf221 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0g7eh5cuk8q3db36uj703g5am218 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qn45si19rkuolv55gaesztt2216 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0966n2qg2hkhm52n9jmkvsta3214 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0189shj48bc6b4sygmq46vbo8y217 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0rb6x2ydonw5w19qxdbe1fou8d212 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ctktk3vapdkont60nv9cob1e215 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gg9pj3itfrmj1vq2ax5mvbqeg220 2021-04-14T12:10:34.610Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0184kjpmscyzmvygd2m0a5d19c210 2021-04-14T12:10:36.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1408313-8a01-49a0-a82f-93673d79d267 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:36.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1408313-8a01-49a0-a82f-93673d79d267 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f9b736d 2021-04-14T12:10:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1408313-8a01-49a0-a82f-93673d79d267 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1408313-8a01-49a0-a82f-93673d79d267 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:36.229Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5718fd3d-9ccf-4d07-a8e7-ac0e11e5fb5f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:10:36.229094Z InvocationID=e5674da7-4f52-4a2f-a3f4-885fbe250200 LogTimestamp=2021-04-14T12:10:36.229184Z Entering 2021-04-14T12:10:36.229Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5718fd3d-9ccf-4d07-a8e7-ac0e11e5fb5f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:10:36.229094Z InvocationID=e5674da7-4f52-4a2f-a3f4-885fbe250200 LogTimestamp=2021-04-14T12:10:36.229184Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:10:36.231Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:10:36.230Z InvocationID=33c00ee5-8fae-439c-a260-beb7a2449ec4 LogTimestamp=2021-04-14T12:10:36.231859Z ResponseDesc=OK Exiting. 2021-04-14T12:10:36.232Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:10:39.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a24469f-5612-4db2-a1a0-538d56d9f254 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a24469f-5612-4db2-a1a0-538d56d9f254 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17af762a 2021-04-14T12:10:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a24469f-5612-4db2-a1a0-538d56d9f254 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a24469f-5612-4db2-a1a0-538d56d9f254 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:41.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92081299-4861-4e15-95ef-e24d15f64f18 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:41.631Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92081299-4861-4e15-95ef-e24d15f64f18 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@756cfad2 2021-04-14T12:10:41.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92081299-4861-4e15-95ef-e24d15f64f18 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:41.632Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=92081299-4861-4e15-95ef-e24d15f64f18 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af391628-d668-44be-98c0-66b628a374c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af391628-d668-44be-98c0-66b628a374c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a113bc0 2021-04-14T12:10:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af391628-d668-44be-98c0-66b628a374c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af391628-d668-44be-98c0-66b628a374c5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:46.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:46.205Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:46.206Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:10:46.216Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:10:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acc0ec8-2c43-474f-9d3e-1296dfa8a949 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acc0ec8-2c43-474f-9d3e-1296dfa8a949 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2eb531f4 2021-04-14T12:10:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acc0ec8-2c43-474f-9d3e-1296dfa8a949 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acc0ec8-2c43-474f-9d3e-1296dfa8a949 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:51.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938b9706-e782-4105-9bbf-183bf8795e67 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:51.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938b9706-e782-4105-9bbf-183bf8795e67 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42470c2e 2021-04-14T12:10:51.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938b9706-e782-4105-9bbf-183bf8795e67 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:51.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=938b9706-e782-4105-9bbf-183bf8795e67 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:53.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61195d52-1afb-4cf0-8e61-a1f4fcb1997c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:53.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61195d52-1afb-4cf0-8e61-a1f4fcb1997c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@506fc4de 2021-04-14T12:10:53.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61195d52-1afb-4cf0-8e61-a1f4fcb1997c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:53.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61195d52-1afb-4cf0-8e61-a1f4fcb1997c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:56.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ab9e7a-6fca-44c4-91c4-3268695f4add PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:56.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ab9e7a-6fca-44c4-91c4-3268695f4add PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53a33a28 2021-04-14T12:10:56.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ab9e7a-6fca-44c4-91c4-3268695f4add PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ab9e7a-6fca-44c4-91c4-3268695f4add PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:10:59.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=638a829c-752f-423b-b5b7-c00b9e1280ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:10:59.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=638a829c-752f-423b-b5b7-c00b9e1280ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@541e9b39 2021-04-14T12:10:59.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=638a829c-752f-423b-b5b7-c00b9e1280ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:10:59.580Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=638a829c-752f-423b-b5b7-c00b9e1280ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:02.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2786a480-a822-4df1-add5-c3a67e5b140b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:02.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2786a480-a822-4df1-add5-c3a67e5b140b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ec2dbe8 2021-04-14T12:11:02.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2786a480-a822-4df1-add5-c3a67e5b140b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:02.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2786a480-a822-4df1-add5-c3a67e5b140b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:11:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:11:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:11:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:11:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:11:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:11:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa18890-64c6-4654-9d0c-a1b9a6ed6e08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa18890-64c6-4654-9d0c-a1b9a6ed6e08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a5a3da 2021-04-14T12:11:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa18890-64c6-4654-9d0c-a1b9a6ed6e08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9aa18890-64c6-4654-9d0c-a1b9a6ed6e08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:06.251Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f46d5607-79fd-4378-924a-1d41c8b06943 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:11:06.250446Z InvocationID=b42f9add-1a59-44ae-9ce6-410469f55784 LogTimestamp=2021-04-14T12:11:06.250541Z Entering 2021-04-14T12:11:06.251Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f46d5607-79fd-4378-924a-1d41c8b06943 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:11:06.250446Z InvocationID=b42f9add-1a59-44ae-9ce6-410469f55784 LogTimestamp=2021-04-14T12:11:06.250541Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:11:06.252Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:11:06.251Z InvocationID=708a1f2a-b6d9-414b-979f-d31f28a7d1e8 LogTimestamp=2021-04-14T12:11:06.252774Z ResponseDesc=OK Exiting. 2021-04-14T12:11:06.253Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:11:08.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aef40d5d-a645-4898-b192-df37c9578246 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:08.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aef40d5d-a645-4898-b192-df37c9578246 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a9dab9c 2021-04-14T12:11:08.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aef40d5d-a645-4898-b192-df37c9578246 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:08.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aef40d5d-a645-4898-b192-df37c9578246 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec2ec1e-4172-4bee-9fe9-3478ce8f40e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec2ec1e-4172-4bee-9fe9-3478ce8f40e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a7a36a5 2021-04-14T12:11:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec2ec1e-4172-4bee-9fe9-3478ce8f40e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ec2ec1e-4172-4bee-9fe9-3478ce8f40e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:14.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da7a6a0-6d32-4383-b69a-812994516dcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:14.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da7a6a0-6d32-4383-b69a-812994516dcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@525fbd99 2021-04-14T12:11:14.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da7a6a0-6d32-4383-b69a-812994516dcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da7a6a0-6d32-4383-b69a-812994516dcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa96ed1-9bc6-401c-a1db-e8164a3bd8ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa96ed1-9bc6-401c-a1db-e8164a3bd8ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fc97f7b 2021-04-14T12:11:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa96ed1-9bc6-401c-a1db-e8164a3bd8ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=baa96ed1-9bc6-401c-a1db-e8164a3bd8ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b9654f-d201-406f-b4f6-914c4f3fdc0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b9654f-d201-406f-b4f6-914c4f3fdc0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58affa55 2021-04-14T12:11:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b9654f-d201-406f-b4f6-914c4f3fdc0a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:20.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b9654f-d201-406f-b4f6-914c4f3fdc0a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c811af0-c15c-48d6-be73-d2a1e329d7ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c811af0-c15c-48d6-be73-d2a1e329d7ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63db30fb 2021-04-14T12:11:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c811af0-c15c-48d6-be73-d2a1e329d7ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c811af0-c15c-48d6-be73-d2a1e329d7ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54089f18-a568-42e9-b57a-698341116f37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54089f18-a568-42e9-b57a-698341116f37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cc7fa6c 2021-04-14T12:11:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54089f18-a568-42e9-b57a-698341116f37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54089f18-a568-42e9-b57a-698341116f37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef65f45d-113d-4fb1-b569-2ee6bc381d70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef65f45d-113d-4fb1-b569-2ee6bc381d70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78c17628 2021-04-14T12:11:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef65f45d-113d-4fb1-b569-2ee6bc381d70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef65f45d-113d-4fb1-b569-2ee6bc381d70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9436567d-4365-483c-94e9-1d4a285dd1f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9436567d-4365-483c-94e9-1d4a285dd1f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f1b4637 2021-04-14T12:11:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9436567d-4365-483c-94e9-1d4a285dd1f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9436567d-4365-483c-94e9-1d4a285dd1f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:36.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91f6024-ca30-42c7-830d-7f525c7f69a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:36.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91f6024-ca30-42c7-830d-7f525c7f69a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65fdf9c7 2021-04-14T12:11:36.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91f6024-ca30-42c7-830d-7f525c7f69a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91f6024-ca30-42c7-830d-7f525c7f69a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:36.234Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6318f4f8-a1d0-4321-9909-7ec21a53afc2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:11:36.234256Z InvocationID=1e69c807-0230-495f-8d3f-c26212022df1 LogTimestamp=2021-04-14T12:11:36.234343Z Entering 2021-04-14T12:11:36.234Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6318f4f8-a1d0-4321-9909-7ec21a53afc2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:11:36.234256Z InvocationID=1e69c807-0230-495f-8d3f-c26212022df1 LogTimestamp=2021-04-14T12:11:36.234343Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:11:36.236Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:11:36.234Z InvocationID=dbdf9fda-dda5-4bb6-b460-72cdcfb82e69 LogTimestamp=2021-04-14T12:11:36.236905Z ResponseDesc=OK Exiting. 2021-04-14T12:11:36.237Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:11:39.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79253222-5be8-479d-b8db-1a2e2674f273 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:39.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79253222-5be8-479d-b8db-1a2e2674f273 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@161a6b8e 2021-04-14T12:11:39.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79253222-5be8-479d-b8db-1a2e2674f273 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:39.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79253222-5be8-479d-b8db-1a2e2674f273 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30182fb0-b5f7-4505-9e90-f0134152a878 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30182fb0-b5f7-4505-9e90-f0134152a878 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65992f53 2021-04-14T12:11:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30182fb0-b5f7-4505-9e90-f0134152a878 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30182fb0-b5f7-4505-9e90-f0134152a878 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:44.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c735acb0-2af5-4284-9fb4-0ac4eaad6dd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:44.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c735acb0-2af5-4284-9fb4-0ac4eaad6dd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6036e729 2021-04-14T12:11:44.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c735acb0-2af5-4284-9fb4-0ac4eaad6dd4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:44.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c735acb0-2af5-4284-9fb4-0ac4eaad6dd4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:46.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:11:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:11:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ee4814-a956-49cc-bff1-4dcb5ece107c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ee4814-a956-49cc-bff1-4dcb5ece107c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a0f1929 2021-04-14T12:11:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ee4814-a956-49cc-bff1-4dcb5ece107c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ee4814-a956-49cc-bff1-4dcb5ece107c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:48.222Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8f0ee0fa-02a0-42cd-8bcd-96bfe3a4640f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:11:48.222254Z InvocationID=2c18e9dd-7295-49be-ad69-9ab20a7ec6b1 LogTimestamp=2021-04-14T12:11:48.222327Z Entering 2021-04-14T12:11:48.222Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8f0ee0fa-02a0-42cd-8bcd-96bfe3a4640f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:11:48.222254Z InvocationID=2c18e9dd-7295-49be-ad69-9ab20a7ec6b1 LogTimestamp=2021-04-14T12:11:48.222327Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:11:48.224Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:11:48.222Z InvocationID=6977c55a-402e-48a1-b1d2-e8bcab7ca928 LogTimestamp=2021-04-14T12:11:48.224734Z ResponseDesc=OK Exiting. 2021-04-14T12:11:48.225Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:11:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2078209e-f7a0-4bcb-af5d-8b37e490a512 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2078209e-f7a0-4bcb-af5d-8b37e490a512 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f8c49fd 2021-04-14T12:11:51.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2078209e-f7a0-4bcb-af5d-8b37e490a512 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:51.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2078209e-f7a0-4bcb-af5d-8b37e490a512 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:53.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e47bc97e-da7a-4bd2-9c61-7fed27c29014 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:53.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e47bc97e-da7a-4bd2-9c61-7fed27c29014 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34308e8 2021-04-14T12:11:53.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e47bc97e-da7a-4bd2-9c61-7fed27c29014 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:53.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e47bc97e-da7a-4bd2-9c61-7fed27c29014 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:56.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfab776-e6e4-43db-aaee-f282e5cd76ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:56.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfab776-e6e4-43db-aaee-f282e5cd76ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@549bb806 2021-04-14T12:11:56.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfab776-e6e4-43db-aaee-f282e5cd76ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:56.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfab776-e6e4-43db-aaee-f282e5cd76ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:11:59.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fedfc9-b1c1-4afb-9b03-5b8569cdc19b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:11:59.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fedfc9-b1c1-4afb-9b03-5b8569cdc19b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@464f25ed 2021-04-14T12:11:59.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fedfc9-b1c1-4afb-9b03-5b8569cdc19b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:11:59.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17fedfc9-b1c1-4afb-9b03-5b8569cdc19b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:02.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9018d684-6734-4d5a-8df3-15ca5158e44f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:02.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9018d684-6734-4d5a-8df3-15ca5158e44f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b414f78 2021-04-14T12:12:02.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9018d684-6734-4d5a-8df3-15ca5158e44f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:02.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9018d684-6734-4d5a-8df3-15ca5158e44f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:12:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:12:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:12:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:12:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:12:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:12:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c034eae-ae59-42aa-9bdf-3fe0aec7b577 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c034eae-ae59-42aa-9bdf-3fe0aec7b577 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10de12b0 2021-04-14T12:12:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c034eae-ae59-42aa-9bdf-3fe0aec7b577 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c034eae-ae59-42aa-9bdf-3fe0aec7b577 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:06.242Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ce272501-0697-4a15-87c1-551fdf6c2960 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:12:06.242397Z InvocationID=5f2f08c2-286d-41f9-a039-799c42c35840 LogTimestamp=2021-04-14T12:12:06.242468Z Entering 2021-04-14T12:12:06.242Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ce272501-0697-4a15-87c1-551fdf6c2960 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:12:06.242397Z InvocationID=5f2f08c2-286d-41f9-a039-799c42c35840 LogTimestamp=2021-04-14T12:12:06.242468Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:12:06.244Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:12:06.243Z InvocationID=460efad8-5003-4713-97c5-7555179329d9 LogTimestamp=2021-04-14T12:12:06.244471Z ResponseDesc=OK Exiting. 2021-04-14T12:12:06.244Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:12:08.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cbd3f44-5ed0-40c5-a047-ab03fe46ccea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:08.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cbd3f44-5ed0-40c5-a047-ab03fe46ccea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@190cc325 2021-04-14T12:12:08.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cbd3f44-5ed0-40c5-a047-ab03fe46ccea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:08.709Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cbd3f44-5ed0-40c5-a047-ab03fe46ccea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827c4a78-8c7e-46b8-bc35-968a94966d73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827c4a78-8c7e-46b8-bc35-968a94966d73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2653fda4 2021-04-14T12:12:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827c4a78-8c7e-46b8-bc35-968a94966d73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=827c4a78-8c7e-46b8-bc35-968a94966d73 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af54ac6-b8bc-4dc3-a7da-e07421203d14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af54ac6-b8bc-4dc3-a7da-e07421203d14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27e85c99 2021-04-14T12:12:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af54ac6-b8bc-4dc3-a7da-e07421203d14 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9af54ac6-b8bc-4dc3-a7da-e07421203d14 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a7a93da-c11f-4952-b601-a0b4334467cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a7a93da-c11f-4952-b601-a0b4334467cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47438146 2021-04-14T12:12:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a7a93da-c11f-4952-b601-a0b4334467cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a7a93da-c11f-4952-b601-a0b4334467cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072d18df-bb3f-4f2a-b7a6-82272380c7a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072d18df-bb3f-4f2a-b7a6-82272380c7a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38a96760 2021-04-14T12:12:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072d18df-bb3f-4f2a-b7a6-82272380c7a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=072d18df-bb3f-4f2a-b7a6-82272380c7a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082856a2-d3ba-4334-86fa-579267a11ea8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082856a2-d3ba-4334-86fa-579267a11ea8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12e030c 2021-04-14T12:12:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082856a2-d3ba-4334-86fa-579267a11ea8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=082856a2-d3ba-4334-86fa-579267a11ea8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1024bf20-e2f6-4bef-b642-8b8a390d0557 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1024bf20-e2f6-4bef-b642-8b8a390d0557 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64479b24 2021-04-14T12:12:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1024bf20-e2f6-4bef-b642-8b8a390d0557 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1024bf20-e2f6-4bef-b642-8b8a390d0557 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:30.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00173dc9-f745-4dcc-b35f-61e261dabdeb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:30.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00173dc9-f745-4dcc-b35f-61e261dabdeb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fd56f5b 2021-04-14T12:12:30.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00173dc9-f745-4dcc-b35f-61e261dabdeb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:30.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00173dc9-f745-4dcc-b35f-61e261dabdeb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:33.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acc18241-dc49-45cd-a86d-218a9370a993 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:33.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acc18241-dc49-45cd-a86d-218a9370a993 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c348da6 2021-04-14T12:12:33.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acc18241-dc49-45cd-a86d-218a9370a993 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:33.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acc18241-dc49-45cd-a86d-218a9370a993 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:35.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d0b8c9-fb70-4962-99b0-840a2fd3ced1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:35.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d0b8c9-fb70-4962-99b0-840a2fd3ced1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d73c14f 2021-04-14T12:12:35.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d0b8c9-fb70-4962-99b0-840a2fd3ced1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:35.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d0b8c9-fb70-4962-99b0-840a2fd3ced1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:36.230Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=51ca2e08-aa85-483d-80ac-b1b996c9e0b7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:12:36.230468Z InvocationID=c8fbd0d9-6e8f-4e0b-8b5b-ee1970f59852 LogTimestamp=2021-04-14T12:12:36.230546Z Entering 2021-04-14T12:12:36.230Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=51ca2e08-aa85-483d-80ac-b1b996c9e0b7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:12:36.230468Z InvocationID=c8fbd0d9-6e8f-4e0b-8b5b-ee1970f59852 LogTimestamp=2021-04-14T12:12:36.230546Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:12:36.232Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:12:36.231Z InvocationID=fde5cfe7-d8a1-4118-8934-9031b1a70170 LogTimestamp=2021-04-14T12:12:36.232434Z ResponseDesc=OK Exiting. 2021-04-14T12:12:36.232Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:12:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e6adf0-4e9c-46ae-91e2-3730db34ed29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e6adf0-4e9c-46ae-91e2-3730db34ed29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65b5f37e 2021-04-14T12:12:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e6adf0-4e9c-46ae-91e2-3730db34ed29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5e6adf0-4e9c-46ae-91e2-3730db34ed29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:41.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19752526-6d3d-4f5e-80dc-0513fea3c501 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:41.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19752526-6d3d-4f5e-80dc-0513fea3c501 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@710ef724 2021-04-14T12:12:41.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19752526-6d3d-4f5e-80dc-0513fea3c501 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:41.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19752526-6d3d-4f5e-80dc-0513fea3c501 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:44.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb202293-b552-4290-892d-375638f92e07 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:44.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb202293-b552-4290-892d-375638f92e07 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@193f0d1e 2021-04-14T12:12:44.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb202293-b552-4290-892d-375638f92e07 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:44.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb202293-b552-4290-892d-375638f92e07 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:12:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:12:47.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232b4091-e060-4411-ae01-1b56aadb0d8c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:47.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232b4091-e060-4411-ae01-1b56aadb0d8c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a65decf 2021-04-14T12:12:47.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232b4091-e060-4411-ae01-1b56aadb0d8c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:47.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=232b4091-e060-4411-ae01-1b56aadb0d8c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f8607b-1dd7-4ebc-b43d-61cbac8291af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f8607b-1dd7-4ebc-b43d-61cbac8291af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7001e4fe 2021-04-14T12:12:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f8607b-1dd7-4ebc-b43d-61cbac8291af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2f8607b-1dd7-4ebc-b43d-61cbac8291af PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:54.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f49fa14-014c-47f0-bf23-4afb37c15760 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:54.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f49fa14-014c-47f0-bf23-4afb37c15760 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76309a0d 2021-04-14T12:12:54.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f49fa14-014c-47f0-bf23-4afb37c15760 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:54.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f49fa14-014c-47f0-bf23-4afb37c15760 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f1e9408-24d2-469c-be76-cc8ba741aefa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f1e9408-24d2-469c-be76-cc8ba741aefa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17063e28 2021-04-14T12:12:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f1e9408-24d2-469c-be76-cc8ba741aefa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f1e9408-24d2-469c-be76-cc8ba741aefa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:12:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ade9b4f-8cfd-4bc0-b1c8-1b4074c8a3fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:12:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ade9b4f-8cfd-4bc0-b1c8-1b4074c8a3fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30109a1 2021-04-14T12:12:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ade9b4f-8cfd-4bc0-b1c8-1b4074c8a3fb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:12:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ade9b4f-8cfd-4bc0-b1c8-1b4074c8a3fb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45465673-e8ce-43a9-9036-a831f456f75f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45465673-e8ce-43a9-9036-a831f456f75f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cd82b2b 2021-04-14T12:13:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45465673-e8ce-43a9-9036-a831f456f75f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45465673-e8ce-43a9-9036-a831f456f75f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:13:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:13:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:13:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:13:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:13:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:13:06.242Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0ac9afec-3666-4b85-bc01-5b30d777e961 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:13:06.241594Z InvocationID=b348f6cb-7e67-4839-868f-2dfe45111ab8 LogTimestamp=2021-04-14T12:13:06.241715Z Entering 2021-04-14T12:13:06.242Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0ac9afec-3666-4b85-bc01-5b30d777e961 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:13:06.241594Z InvocationID=b348f6cb-7e67-4839-868f-2dfe45111ab8 LogTimestamp=2021-04-14T12:13:06.241715Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:13:06.244Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:13:06.242Z InvocationID=6cdb5108-607d-4130-9e98-d4aa96499406 LogTimestamp=2021-04-14T12:13:06.244044Z ResponseDesc=OK Exiting. 2021-04-14T12:13:06.244Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:13:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe34a2-f657-440b-ba0e-9a862b2ecade PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe34a2-f657-440b-ba0e-9a862b2ecade PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@eca364f 2021-04-14T12:13:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe34a2-f657-440b-ba0e-9a862b2ecade PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:06.486Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36fe34a2-f657-440b-ba0e-9a862b2ecade PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:09.101Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995c4b30-3ecb-4d59-8225-eaa8ba90dafd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:09.101Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995c4b30-3ecb-4d59-8225-eaa8ba90dafd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@281baec0 2021-04-14T12:13:09.101Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995c4b30-3ecb-4d59-8225-eaa8ba90dafd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:09.101Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=995c4b30-3ecb-4d59-8225-eaa8ba90dafd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4154c07-4478-4aaa-98dd-0dff2ee854f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4154c07-4478-4aaa-98dd-0dff2ee854f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23dcf663 2021-04-14T12:13:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4154c07-4478-4aaa-98dd-0dff2ee854f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:12.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4154c07-4478-4aaa-98dd-0dff2ee854f9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:14.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca300861-6706-412e-9f0f-b86c8520b74e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:14.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca300861-6706-412e-9f0f-b86c8520b74e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee00040 2021-04-14T12:13:14.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca300861-6706-412e-9f0f-b86c8520b74e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:14.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca300861-6706-412e-9f0f-b86c8520b74e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:16.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:16.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:17.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=239cd1fe-6f32-44c5-b348-71cb03e11a1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:17.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=239cd1fe-6f32-44c5-b348-71cb03e11a1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4147259d 2021-04-14T12:13:17.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=239cd1fe-6f32-44c5-b348-71cb03e11a1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:17.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=239cd1fe-6f32-44c5-b348-71cb03e11a1d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f948a2-1e3a-401e-807a-f1862f7133d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f948a2-1e3a-401e-807a-f1862f7133d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@345feedb 2021-04-14T12:13:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f948a2-1e3a-401e-807a-f1862f7133d6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f948a2-1e3a-401e-807a-f1862f7133d6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52f9310-4d4e-4ae9-85a1-7d40081e1c94 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52f9310-4d4e-4ae9-85a1-7d40081e1c94 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70f469dd 2021-04-14T12:13:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52f9310-4d4e-4ae9-85a1-7d40081e1c94 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:24.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a52f9310-4d4e-4ae9-85a1-7d40081e1c94 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:26.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d14b3f1f-ea3a-42c3-bd71-c139e65eb27c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:26.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d14b3f1f-ea3a-42c3-bd71-c139e65eb27c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e889583 2021-04-14T12:13:26.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d14b3f1f-ea3a-42c3-bd71-c139e65eb27c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:26.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d14b3f1f-ea3a-42c3-bd71-c139e65eb27c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:29.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbf5c7c-49c9-4cf2-aaab-3cbe02766178 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:29.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbf5c7c-49c9-4cf2-aaab-3cbe02766178 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@169b3e02 2021-04-14T12:13:29.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbf5c7c-49c9-4cf2-aaab-3cbe02766178 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:29.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcbf5c7c-49c9-4cf2-aaab-3cbe02766178 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e281452-64ce-4fc1-af11-1ce083a9acd1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e281452-64ce-4fc1-af11-1ce083a9acd1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d79233c 2021-04-14T12:13:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e281452-64ce-4fc1-af11-1ce083a9acd1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e281452-64ce-4fc1-af11-1ce083a9acd1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:35.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517bfc37-9d17-411a-a579-f6341fc637ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:35.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517bfc37-9d17-411a-a579-f6341fc637ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e9003cf 2021-04-14T12:13:35.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517bfc37-9d17-411a-a579-f6341fc637ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:35.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517bfc37-9d17-411a-a579-f6341fc637ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:36.242Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1ac16c3f-2a26-495b-97b4-480d8e4ad12f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:13:36.242077Z InvocationID=7ffece5a-d859-4852-a78d-94b01f1241f8 LogTimestamp=2021-04-14T12:13:36.242192Z Entering 2021-04-14T12:13:36.242Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1ac16c3f-2a26-495b-97b4-480d8e4ad12f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:13:36.242077Z InvocationID=7ffece5a-d859-4852-a78d-94b01f1241f8 LogTimestamp=2021-04-14T12:13:36.242192Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:13:36.245Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:13:36.243Z InvocationID=e3e19bac-084c-41bc-8bb8-0bd02b96c865 LogTimestamp=2021-04-14T12:13:36.245757Z ResponseDesc=OK Exiting. 2021-04-14T12:13:36.246Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:13:39.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc69fd4d-c37f-4b35-8ad5-e2ea47b674f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:39.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc69fd4d-c37f-4b35-8ad5-e2ea47b674f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@249ebb13 2021-04-14T12:13:39.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc69fd4d-c37f-4b35-8ad5-e2ea47b674f7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:39.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc69fd4d-c37f-4b35-8ad5-e2ea47b674f7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d302bef0-95a0-4d66-be77-6ecd4f810043 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d302bef0-95a0-4d66-be77-6ecd4f810043 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b3aeaac 2021-04-14T12:13:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d302bef0-95a0-4d66-be77-6ecd4f810043 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:41.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d302bef0-95a0-4d66-be77-6ecd4f810043 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed6335f-1b99-4067-91f4-7502ae5caaf5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:45.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed6335f-1b99-4067-91f4-7502ae5caaf5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f4e4434 2021-04-14T12:13:45.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed6335f-1b99-4067-91f4-7502ae5caaf5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:45.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed6335f-1b99-4067-91f4-7502ae5caaf5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:13:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:13:47.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04227d0d-66fe-44ed-b7c2-84ae68b29b62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:47.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04227d0d-66fe-44ed-b7c2-84ae68b29b62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71cebe69 2021-04-14T12:13:47.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04227d0d-66fe-44ed-b7c2-84ae68b29b62 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:47.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04227d0d-66fe-44ed-b7c2-84ae68b29b62 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:48.216Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fc22a71c-bb44-4800-819a-223622d00be4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:13:48.216263Z InvocationID=d12d5cbd-2191-4a42-a22e-87c15a5e2c62 LogTimestamp=2021-04-14T12:13:48.216332Z Entering 2021-04-14T12:13:48.216Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fc22a71c-bb44-4800-819a-223622d00be4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:13:48.216263Z InvocationID=d12d5cbd-2191-4a42-a22e-87c15a5e2c62 LogTimestamp=2021-04-14T12:13:48.216332Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:13:48.218Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:13:48.216Z InvocationID=528519b1-f248-4b3e-8e33-5a8868e91505 LogTimestamp=2021-04-14T12:13:48.218134Z ResponseDesc=OK Exiting. 2021-04-14T12:13:48.218Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:13:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb79ef67-f8a0-4a06-ad97-a1ac7035fed1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb79ef67-f8a0-4a06-ad97-a1ac7035fed1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20d9d560 2021-04-14T12:13:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb79ef67-f8a0-4a06-ad97-a1ac7035fed1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb79ef67-f8a0-4a06-ad97-a1ac7035fed1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:53.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83a65961-0a3c-4a51-a4fd-0338416dfb68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:53.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83a65961-0a3c-4a51-a4fd-0338416dfb68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c0a345d 2021-04-14T12:13:53.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83a65961-0a3c-4a51-a4fd-0338416dfb68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:53.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83a65961-0a3c-4a51-a4fd-0338416dfb68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614ba83c-3d0c-4ac2-8b49-2cbce44af112 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614ba83c-3d0c-4ac2-8b49-2cbce44af112 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1168ac0c 2021-04-14T12:13:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614ba83c-3d0c-4ac2-8b49-2cbce44af112 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:57.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614ba83c-3d0c-4ac2-8b49-2cbce44af112 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:13:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a047efe3-fdab-46c0-84b5-4d2fc5ae1bfc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:13:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a047efe3-fdab-46c0-84b5-4d2fc5ae1bfc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@155175be 2021-04-14T12:13:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a047efe3-fdab-46c0-84b5-4d2fc5ae1bfc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:13:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a047efe3-fdab-46c0-84b5-4d2fc5ae1bfc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb461c-b05a-43cc-babd-ddfbf800212f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb461c-b05a-43cc-babd-ddfbf800212f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bcdc0a1 2021-04-14T12:14:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb461c-b05a-43cc-babd-ddfbf800212f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb461c-b05a-43cc-babd-ddfbf800212f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:14:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:14:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:14:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:14:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:14:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:14:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd85ebe5-9148-4189-b368-3e327d594108 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd85ebe5-9148-4189-b368-3e327d594108 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36a8bb59 2021-04-14T12:14:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd85ebe5-9148-4189-b368-3e327d594108 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd85ebe5-9148-4189-b368-3e327d594108 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:06.237Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a6ee7106-5f44-4c81-ae5d-d13ec1ce9d3e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:14:06.236809Z InvocationID=128dfc54-be9d-4408-852b-a3a7ee7363d5 LogTimestamp=2021-04-14T12:14:06.236873Z Entering 2021-04-14T12:14:06.237Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a6ee7106-5f44-4c81-ae5d-d13ec1ce9d3e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:14:06.236809Z InvocationID=128dfc54-be9d-4408-852b-a3a7ee7363d5 LogTimestamp=2021-04-14T12:14:06.236873Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:14:06.238Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:14:06.237Z InvocationID=92363f8b-aa44-4069-b537-5fd633bdc3d5 LogTimestamp=2021-04-14T12:14:06.238376Z ResponseDesc=OK Exiting. 2021-04-14T12:14:06.238Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:14:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aca943e-4e82-4ce1-83d2-55721129cab8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aca943e-4e82-4ce1-83d2-55721129cab8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6274694c 2021-04-14T12:14:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aca943e-4e82-4ce1-83d2-55721129cab8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0aca943e-4e82-4ce1-83d2-55721129cab8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa4af41-3cf7-47f6-977b-0e8dc0c5ed43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa4af41-3cf7-47f6-977b-0e8dc0c5ed43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c961c39 2021-04-14T12:14:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa4af41-3cf7-47f6-977b-0e8dc0c5ed43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fa4af41-3cf7-47f6-977b-0e8dc0c5ed43 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:14.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa8374c-cd96-4ecf-aeb4-cb86cde24a20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:14.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa8374c-cd96-4ecf-aeb4-cb86cde24a20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@694b13c2 2021-04-14T12:14:14.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa8374c-cd96-4ecf-aeb4-cb86cde24a20 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:14.613Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eaa8374c-cd96-4ecf-aeb4-cb86cde24a20 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:18.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f68b03-d392-42ff-a4be-8e957dc3a328 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:18.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f68b03-d392-42ff-a4be-8e957dc3a328 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1aca1fc1 2021-04-14T12:14:18.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f68b03-d392-42ff-a4be-8e957dc3a328 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:18.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f68b03-d392-42ff-a4be-8e957dc3a328 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:20.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee045dd-55bb-4c42-988f-ed632432c622 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:20.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee045dd-55bb-4c42-988f-ed632432c622 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b353bdd 2021-04-14T12:14:20.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee045dd-55bb-4c42-988f-ed632432c622 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:20.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee045dd-55bb-4c42-988f-ed632432c622 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ba549e-1046-4d49-9b0c-ec5a58a9f950 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ba549e-1046-4d49-9b0c-ec5a58a9f950 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@178e9356 2021-04-14T12:14:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ba549e-1046-4d49-9b0c-ec5a58a9f950 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1ba549e-1046-4d49-9b0c-ec5a58a9f950 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:27.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a939059-8b52-4e61-9f86-93fb1fa2cad3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:27.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a939059-8b52-4e61-9f86-93fb1fa2cad3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@266a5766 2021-04-14T12:14:27.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a939059-8b52-4e61-9f86-93fb1fa2cad3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:27.240Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a939059-8b52-4e61-9f86-93fb1fa2cad3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:29.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e4f85f-fe26-4791-9397-6db755d707c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:29.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e4f85f-fe26-4791-9397-6db755d707c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c94607d 2021-04-14T12:14:29.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e4f85f-fe26-4791-9397-6db755d707c1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:29.820Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90e4f85f-fe26-4791-9397-6db755d707c1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55ebe252-a7c4-4a86-bbeb-eac5b6e4860d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55ebe252-a7c4-4a86-bbeb-eac5b6e4860d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e8d55e1 2021-04-14T12:14:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55ebe252-a7c4-4a86-bbeb-eac5b6e4860d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55ebe252-a7c4-4a86-bbeb-eac5b6e4860d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36f71872-3a59-49a7-b0f2-0791d9e6195f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36f71872-3a59-49a7-b0f2-0791d9e6195f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d7a7145 2021-04-14T12:14:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36f71872-3a59-49a7-b0f2-0791d9e6195f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36f71872-3a59-49a7-b0f2-0791d9e6195f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:36.225Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fa25b5bf-c1e5-4fa5-9877-de9036c7ea63 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:14:36.225068Z InvocationID=0683a2cb-fd1f-40ec-b219-e9f45fe10d55 LogTimestamp=2021-04-14T12:14:36.225174Z Entering 2021-04-14T12:14:36.226Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fa25b5bf-c1e5-4fa5-9877-de9036c7ea63 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:14:36.225068Z InvocationID=0683a2cb-fd1f-40ec-b219-e9f45fe10d55 LogTimestamp=2021-04-14T12:14:36.225174Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:14:36.228Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:14:36.226Z InvocationID=f6cb70d2-1fe1-4072-83d7-314b9eb9eae5 LogTimestamp=2021-04-14T12:14:36.227999Z ResponseDesc=OK Exiting. 2021-04-14T12:14:36.228Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:14:38.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa38e455-91d2-4f92-a70c-77995978e780 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:38.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa38e455-91d2-4f92-a70c-77995978e780 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@95fc8eb 2021-04-14T12:14:38.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa38e455-91d2-4f92-a70c-77995978e780 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:38.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aa38e455-91d2-4f92-a70c-77995978e780 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:41.610Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59996c05-0a0b-470e-9564-1fc4e13508ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:41.610Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59996c05-0a0b-470e-9564-1fc4e13508ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4607c635 2021-04-14T12:14:41.610Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59996c05-0a0b-470e-9564-1fc4e13508ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:41.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59996c05-0a0b-470e-9564-1fc4e13508ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:44.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7bbe65d-50ee-44e8-bcc5-92d968665da5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:44.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7bbe65d-50ee-44e8-bcc5-92d968665da5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32d1b149 2021-04-14T12:14:44.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7bbe65d-50ee-44e8-bcc5-92d968665da5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:44.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7bbe65d-50ee-44e8-bcc5-92d968665da5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:14:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:14:47.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b518af-69d4-470f-bc5a-549e4e9a169d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:47.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b518af-69d4-470f-bc5a-549e4e9a169d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c8f0e0f 2021-04-14T12:14:47.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b518af-69d4-470f-bc5a-549e4e9a169d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:47.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b518af-69d4-470f-bc5a-549e4e9a169d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb2786d-0cb1-49af-be62-547a723919af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb2786d-0cb1-49af-be62-547a723919af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6be085e5 2021-04-14T12:14:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb2786d-0cb1-49af-be62-547a723919af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccb2786d-0cb1-49af-be62-547a723919af PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37697c4-8ab2-4b84-bfba-242b97bb1098 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37697c4-8ab2-4b84-bfba-242b97bb1098 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13aed0c2 2021-04-14T12:14:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37697c4-8ab2-4b84-bfba-242b97bb1098 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c37697c4-8ab2-4b84-bfba-242b97bb1098 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee3ef779-e855-4372-a07e-e8cdd6c20e61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee3ef779-e855-4372-a07e-e8cdd6c20e61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cca7007 2021-04-14T12:14:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee3ef779-e855-4372-a07e-e8cdd6c20e61 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee3ef779-e855-4372-a07e-e8cdd6c20e61 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:14:59.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770b6cc2-445a-4f9b-8940-f7d804bddf2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:14:59.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770b6cc2-445a-4f9b-8940-f7d804bddf2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4851fce7 2021-04-14T12:14:59.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770b6cc2-445a-4f9b-8940-f7d804bddf2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:14:59.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=770b6cc2-445a-4f9b-8940-f7d804bddf2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:02.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87883f2c-33d8-4f5e-9428-4e603d7accaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87883f2c-33d8-4f5e-9428-4e603d7accaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27f197a5 2021-04-14T12:15:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87883f2c-33d8-4f5e-9428-4e603d7accaf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87883f2c-33d8-4f5e-9428-4e603d7accaf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:15:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:15:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:15:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:15:04.359Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:04.359Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:15:04.360Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:15:06.247Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=46fca8b5-a882-4ac5-972e-de52e684443f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:15:06.246820Z InvocationID=7c874c15-3471-416f-be54-899c82159835 LogTimestamp=2021-04-14T12:15:06.246947Z Entering 2021-04-14T12:15:06.247Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=46fca8b5-a882-4ac5-972e-de52e684443f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:15:06.246820Z InvocationID=7c874c15-3471-416f-be54-899c82159835 LogTimestamp=2021-04-14T12:15:06.246947Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:15:06.251Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:15:06.248Z InvocationID=6628a69d-bd0b-49b8-9bca-96ccd38bf170 LogTimestamp=2021-04-14T12:15:06.251362Z ResponseDesc=OK Exiting. 2021-04-14T12:15:06.251Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:15:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8480db8d-0898-4ce9-9b62-2dea23597abc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8480db8d-0898-4ce9-9b62-2dea23597abc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42bc7b59 2021-04-14T12:15:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8480db8d-0898-4ce9-9b62-2dea23597abc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8480db8d-0898-4ce9-9b62-2dea23597abc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d497ac1e-81a2-41e5-9f1e-d7ab88771ff1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d497ac1e-81a2-41e5-9f1e-d7ab88771ff1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d897141 2021-04-14T12:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d497ac1e-81a2-41e5-9f1e-d7ab88771ff1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d497ac1e-81a2-41e5-9f1e-d7ab88771ff1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:12.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb29d873-2fc3-4cc2-8b5b-1b4e805c607e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:12.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb29d873-2fc3-4cc2-8b5b-1b4e805c607e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7af804d3 2021-04-14T12:15:12.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb29d873-2fc3-4cc2-8b5b-1b4e805c607e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:12.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb29d873-2fc3-4cc2-8b5b-1b4e805c607e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:14.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8735ff-68c8-4641-8d0b-b3dbb92ff072 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:14.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8735ff-68c8-4641-8d0b-b3dbb92ff072 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@511fe896 2021-04-14T12:15:14.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8735ff-68c8-4641-8d0b-b3dbb92ff072 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:14.704Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f8735ff-68c8-4641-8d0b-b3dbb92ff072 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:18.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81d16521-227a-4fff-9a9b-9976cfe16faa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:18.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81d16521-227a-4fff-9a9b-9976cfe16faa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70d8375f 2021-04-14T12:15:18.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81d16521-227a-4fff-9a9b-9976cfe16faa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:18.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81d16521-227a-4fff-9a9b-9976cfe16faa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:20.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2a383c-bd73-467f-b869-c9226d04286a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:20.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2a383c-bd73-467f-b869-c9226d04286a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ad537c 2021-04-14T12:15:20.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2a383c-bd73-467f-b869-c9226d04286a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b2a383c-bd73-467f-b869-c9226d04286a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11a12b45-4c3b-4294-bb6f-7505255e3546 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11a12b45-4c3b-4294-bb6f-7505255e3546 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c4901e6 2021-04-14T12:15:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11a12b45-4c3b-4294-bb6f-7505255e3546 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11a12b45-4c3b-4294-bb6f-7505255e3546 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff6b5966-db2f-43d6-b2d4-bbd3048eabae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff6b5966-db2f-43d6-b2d4-bbd3048eabae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12bc15a1 2021-04-14T12:15:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff6b5966-db2f-43d6-b2d4-bbd3048eabae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:27.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff6b5966-db2f-43d6-b2d4-bbd3048eabae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ce0bd5e-ae1a-4d39-845e-5c41712ed338 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ce0bd5e-ae1a-4d39-845e-5c41712ed338 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23efba66 2021-04-14T12:15:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ce0bd5e-ae1a-4d39-845e-5c41712ed338 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ce0bd5e-ae1a-4d39-845e-5c41712ed338 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:15:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79fd4401-2062-401e-9ac3-d737a0fabeb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79fd4401-2062-401e-9ac3-d737a0fabeb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f353bd4 2021-04-14T12:15:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79fd4401-2062-401e-9ac3-d737a0fabeb3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79fd4401-2062-401e-9ac3-d737a0fabeb3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e3f289-d249-454f-ae3c-47c376f57fb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e3f289-d249-454f-ae3c-47c376f57fb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b8755e5 2021-04-14T12:15:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e3f289-d249-454f-ae3c-47c376f57fb4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e3f289-d249-454f-ae3c-47c376f57fb4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:36.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d396cff6-4b00-4df5-bc44-520dce2fe3f3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:15:36.236346Z InvocationID=be3745dd-9352-4f9b-91f3-507cb52657e4 LogTimestamp=2021-04-14T12:15:36.236471Z Entering 2021-04-14T12:15:36.237Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d396cff6-4b00-4df5-bc44-520dce2fe3f3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:15:36.236346Z InvocationID=be3745dd-9352-4f9b-91f3-507cb52657e4 LogTimestamp=2021-04-14T12:15:36.236471Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:15:36.239Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:15:36.237Z InvocationID=cb4a8a6d-20d2-42d9-9069-e9f618a96a07 LogTimestamp=2021-04-14T12:15:36.238873Z ResponseDesc=OK Exiting. 2021-04-14T12:15:36.239Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:15:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c16143f-8e5f-4cdc-bda0-edb12839c6ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c16143f-8e5f-4cdc-bda0-edb12839c6ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49645e29 2021-04-14T12:15:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c16143f-8e5f-4cdc-bda0-edb12839c6ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c16143f-8e5f-4cdc-bda0-edb12839c6ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:41.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be43214-71b2-4728-b0ce-d224a0fb0c98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:41.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be43214-71b2-4728-b0ce-d224a0fb0c98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1706f1e9 2021-04-14T12:15:41.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be43214-71b2-4728-b0ce-d224a0fb0c98 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:41.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6be43214-71b2-4728-b0ce-d224a0fb0c98 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:45.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ffbb890-f6e9-449c-9652-b74bded2f4c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:45.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ffbb890-f6e9-449c-9652-b74bded2f4c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@718b9346 2021-04-14T12:15:45.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ffbb890-f6e9-449c-9652-b74bded2f4c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:45.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ffbb890-f6e9-449c-9652-b74bded2f4c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:15:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e42ec06c-6e08-48fd-a08a-0a103ba5c569 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e42ec06c-6e08-48fd-a08a-0a103ba5c569 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70a2d8ef 2021-04-14T12:15:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e42ec06c-6e08-48fd-a08a-0a103ba5c569 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e42ec06c-6e08-48fd-a08a-0a103ba5c569 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:48.245Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=572a4cec-f4da-49ec-a666-9a565cf2b469 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:15:48.244465Z InvocationID=1bc76f96-03b6-4e34-a52a-428cc00fb402 LogTimestamp=2021-04-14T12:15:48.244637Z Entering 2021-04-14T12:15:48.245Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=572a4cec-f4da-49ec-a666-9a565cf2b469 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:15:48.244465Z InvocationID=1bc76f96-03b6-4e34-a52a-428cc00fb402 LogTimestamp=2021-04-14T12:15:48.244637Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:15:48.249Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:15:48.245Z InvocationID=8e8c1640-6314-4405-a5bf-6d24fa108458 LogTimestamp=2021-04-14T12:15:48.247204Z ResponseDesc=OK Exiting. 2021-04-14T12:15:48.249Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:15:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6006b83e-8943-4e5d-8002-bf663b763a95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6006b83e-8943-4e5d-8002-bf663b763a95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bdc45c4 2021-04-14T12:15:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6006b83e-8943-4e5d-8002-bf663b763a95 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6006b83e-8943-4e5d-8002-bf663b763a95 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:54.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2629cec-cde0-4ba3-ade3-e43f6aacb609 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:54.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2629cec-cde0-4ba3-ade3-e43f6aacb609 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bf576ef 2021-04-14T12:15:54.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2629cec-cde0-4ba3-ade3-e43f6aacb609 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:54.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2629cec-cde0-4ba3-ade3-e43f6aacb609 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614e811e-f97b-4dea-9efe-dbc8684ec53c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614e811e-f97b-4dea-9efe-dbc8684ec53c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1649d374 2021-04-14T12:15:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614e811e-f97b-4dea-9efe-dbc8684ec53c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=614e811e-f97b-4dea-9efe-dbc8684ec53c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:15:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14668682-dc86-467f-aa86-50a1e9df7936 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:15:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14668682-dc86-467f-aa86-50a1e9df7936 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70ca14f2 2021-04-14T12:15:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14668682-dc86-467f-aa86-50a1e9df7936 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:15:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14668682-dc86-467f-aa86-50a1e9df7936 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4e882a9-2307-4dea-9286-b042ed63df6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4e882a9-2307-4dea-9286-b042ed63df6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9c19d4a 2021-04-14T12:16:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4e882a9-2307-4dea-9286-b042ed63df6e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4e882a9-2307-4dea-9286-b042ed63df6e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:16:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:16:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:16:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:16:06.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd529d80-32c2-4a44-80d9-28def48b3ed0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:06.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd529d80-32c2-4a44-80d9-28def48b3ed0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1993d093 2021-04-14T12:16:06.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd529d80-32c2-4a44-80d9-28def48b3ed0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:06.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd529d80-32c2-4a44-80d9-28def48b3ed0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca885c-77ad-4401-b48d-f0bb05d6611e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca885c-77ad-4401-b48d-f0bb05d6611e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@411972a6 2021-04-14T12:16:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca885c-77ad-4401-b48d-f0bb05d6611e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ca885c-77ad-4401-b48d-f0bb05d6611e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ef44a9-6f24-4193-aea6-78b6db3f487c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ef44a9-6f24-4193-aea6-78b6db3f487c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61d493f3 2021-04-14T12:16:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ef44a9-6f24-4193-aea6-78b6db3f487c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3ef44a9-6f24-4193-aea6-78b6db3f487c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:14.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8148c9e8-0586-4203-86db-36e8394a2571 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:14.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8148c9e8-0586-4203-86db-36e8394a2571 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64fa694e 2021-04-14T12:16:14.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8148c9e8-0586-4203-86db-36e8394a2571 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:14.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8148c9e8-0586-4203-86db-36e8394a2571 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da1afb6-6e2b-4ffc-a4c3-8b722434aee0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:18.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da1afb6-6e2b-4ffc-a4c3-8b722434aee0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@636a2a0a 2021-04-14T12:16:18.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da1afb6-6e2b-4ffc-a4c3-8b722434aee0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:18.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0da1afb6-6e2b-4ffc-a4c3-8b722434aee0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2e2594-672c-4d1c-938d-e17d51e040cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2e2594-672c-4d1c-938d-e17d51e040cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@696ce883 2021-04-14T12:16:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2e2594-672c-4d1c-938d-e17d51e040cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ef2e2594-672c-4d1c-938d-e17d51e040cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=422bacf0-c442-4cb5-8e41-4536f8b2f22f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=422bacf0-c442-4cb5-8e41-4536f8b2f22f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c62b556 2021-04-14T12:16:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=422bacf0-c442-4cb5-8e41-4536f8b2f22f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=422bacf0-c442-4cb5-8e41-4536f8b2f22f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:24.447Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4e5ef205-0a08-4eb0-9d6c-c1fac7cb3afe InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:16:24.446517Z InvocationID=0b265c04-4fed-4b21-8b7b-3238fa2236c3 LogTimestamp=2021-04-14T12:16:24.446596Z Entering 2021-04-14T12:16:24.447Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4e5ef205-0a08-4eb0-9d6c-c1fac7cb3afe InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:16:24.446517Z InvocationID=0b265c04-4fed-4b21-8b7b-3238fa2236c3 LogTimestamp=2021-04-14T12:16:24.446596Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:16:24.450Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:16:24.447Z InvocationID=8affdd5d-2ede-4364-99a0-3055ee691bd1 LogTimestamp=2021-04-14T12:16:24.450277Z ResponseDesc=OK Exiting. 2021-04-14T12:16:24.450Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:16:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db177b00-04b7-4ecc-ac9a-8472319fcf73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db177b00-04b7-4ecc-ac9a-8472319fcf73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1be5098d 2021-04-14T12:16:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db177b00-04b7-4ecc-ac9a-8472319fcf73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db177b00-04b7-4ecc-ac9a-8472319fcf73 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:30.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc866e29-98b7-4a8b-a116-3aebad2cba71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:30.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc866e29-98b7-4a8b-a116-3aebad2cba71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e3a5e75 2021-04-14T12:16:30.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc866e29-98b7-4a8b-a116-3aebad2cba71 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:30.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc866e29-98b7-4a8b-a116-3aebad2cba71 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9a889a-6496-40be-b003-3c53743ace36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:33.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9a889a-6496-40be-b003-3c53743ace36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d20855e 2021-04-14T12:16:33.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9a889a-6496-40be-b003-3c53743ace36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:33.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd9a889a-6496-40be-b003-3c53743ace36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f99c721-fb56-4ad1-9729-bfd03d16292b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f99c721-fb56-4ad1-9729-bfd03d16292b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6edaeb29 2021-04-14T12:16:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f99c721-fb56-4ad1-9729-bfd03d16292b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f99c721-fb56-4ad1-9729-bfd03d16292b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97967283-4a48-4087-b202-e55b6edcf305 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:38.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97967283-4a48-4087-b202-e55b6edcf305 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1554ecd2 2021-04-14T12:16:38.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97967283-4a48-4087-b202-e55b6edcf305 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:38.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=97967283-4a48-4087-b202-e55b6edcf305 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ad96c9-fe29-40c9-a1b4-3cda09b0778b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ad96c9-fe29-40c9-a1b4-3cda09b0778b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59d1c1fb 2021-04-14T12:16:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ad96c9-fe29-40c9-a1b4-3cda09b0778b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ad96c9-fe29-40c9-a1b4-3cda09b0778b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=543808f6-155a-408b-b9a8-8c1e140988f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=543808f6-155a-408b-b9a8-8c1e140988f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70f2a5ea 2021-04-14T12:16:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=543808f6-155a-408b-b9a8-8c1e140988f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=543808f6-155a-408b-b9a8-8c1e140988f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:47.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57764abf-d994-4afb-ba7f-3e1b00aed9c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:47.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57764abf-d994-4afb-ba7f-3e1b00aed9c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49489b7e 2021-04-14T12:16:47.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57764abf-d994-4afb-ba7f-3e1b00aed9c1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:47.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57764abf-d994-4afb-ba7f-3e1b00aed9c1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6d582c-5fe9-4f9e-bdd9-4d48342c3d34 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6d582c-5fe9-4f9e-bdd9-4d48342c3d34 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b48ccf9 2021-04-14T12:16:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6d582c-5fe9-4f9e-bdd9-4d48342c3d34 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f6d582c-5fe9-4f9e-bdd9-4d48342c3d34 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:53.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65be4cd-ae2e-47b9-9fb7-c3d7c1d79ac7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:53.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65be4cd-ae2e-47b9-9fb7-c3d7c1d79ac7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cc11472 2021-04-14T12:16:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65be4cd-ae2e-47b9-9fb7-c3d7c1d79ac7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d65be4cd-ae2e-47b9-9fb7-c3d7c1d79ac7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:54.414Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:54.417Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:54.417Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:54.417Z [TopicPollingThread-1] WARN c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Topic not found: /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:16:54.443Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:54.444Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:54.450Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=aeb19037-469e-46f5-a688-e117dd1773b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:16:54.450340Z InvocationID=0acc4ad8-b995-4034-8f8d-8d3124467f51 LogTimestamp=2021-04-14T12:16:54.450393Z Entering 2021-04-14T12:16:54.450Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=aeb19037-469e-46f5-a688-e117dd1773b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:16:54.450340Z InvocationID=0acc4ad8-b995-4034-8f8d-8d3124467f51 LogTimestamp=2021-04-14T12:16:54.450393Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:16:54.452Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:16:54.451Z InvocationID=2b8f06fb-a071-4a1c-a8bf-069ae02e8bbb LogTimestamp=2021-04-14T12:16:54.451990Z ResponseDesc=OK Exiting. 2021-04-14T12:16:54.452Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:16:54.469Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:54.470Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:56.596Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:56.598Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79810bf9-c55b-480d-85c4-a08a165324b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79810bf9-c55b-480d-85c4-a08a165324b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@497929f5 2021-04-14T12:16:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79810bf9-c55b-480d-85c4-a08a165324b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79810bf9-c55b-480d-85c4-a08a165324b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:16:57.569Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:57.571Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:57.579Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:57.580Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:57.601Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:16:57.602Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:16:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91dc854f-b374-42bc-8a93-398b8e7cdbd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:16:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91dc854f-b374-42bc-8a93-398b8e7cdbd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4467c8cf 2021-04-14T12:16:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91dc854f-b374-42bc-8a93-398b8e7cdbd4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:16:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91dc854f-b374-42bc-8a93-398b8e7cdbd4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:02.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cba145-ef73-4556-ac26-49521c9d01a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:02.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cba145-ef73-4556-ac26-49521c9d01a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79f5ebbe 2021-04-14T12:17:02.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cba145-ef73-4556-ac26-49521c9d01a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:02.750Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cba145-ef73-4556-ac26-49521c9d01a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=359c6d9b-d96e-454e-8539-19ea5c6aec79 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=359c6d9b-d96e-454e-8539-19ea5c6aec79 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d331276 2021-04-14T12:17:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=359c6d9b-d96e-454e-8539-19ea5c6aec79 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=359c6d9b-d96e-454e-8539-19ea5c6aec79 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:06.229Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8f6cbb33-1672-4b64-afcd-c2a0bb161465 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:17:06.228798Z InvocationID=2733a10e-807e-426a-b4f1-37396c426915 LogTimestamp=2021-04-14T12:17:06.228842Z Entering 2021-04-14T12:17:06.229Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8f6cbb33-1672-4b64-afcd-c2a0bb161465 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:17:06.228798Z InvocationID=2733a10e-807e-426a-b4f1-37396c426915 LogTimestamp=2021-04-14T12:17:06.228842Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:17:06.230Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:17:06.229Z InvocationID=de2f639b-e4d8-48f9-90ff-e0924ce95cdf LogTimestamp=2021-04-14T12:17:06.230583Z ResponseDesc=OK Exiting. 2021-04-14T12:17:06.230Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:17:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c8bc80-b0ac-4410-b388-bc71f2fe7ce6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c8bc80-b0ac-4410-b388-bc71f2fe7ce6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d05aea4 2021-04-14T12:17:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c8bc80-b0ac-4410-b388-bc71f2fe7ce6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f6c8bc80-b0ac-4410-b388-bc71f2fe7ce6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:09.417Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:17:09.418Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:17:09.418Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:17:11.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c929d993-c645-49a3-8b4f-b0fd05954b84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:11.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c929d993-c645-49a3-8b4f-b0fd05954b84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@275e347b 2021-04-14T12:17:11.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c929d993-c645-49a3-8b4f-b0fd05954b84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:11.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c929d993-c645-49a3-8b4f-b0fd05954b84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:14.680Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9229be1-134b-4fa6-9278-66a0eac60297 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9229be1-134b-4fa6-9278-66a0eac60297 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71a08335 2021-04-14T12:17:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9229be1-134b-4fa6-9278-66a0eac60297 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9229be1-134b-4fa6-9278-66a0eac60297 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:16.469Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:17:16.471Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:17:17.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d691e7ae-6bd7-46bd-899d-e49f5a159802 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:17.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d691e7ae-6bd7-46bd-899d-e49f5a159802 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34c58fd5 2021-04-14T12:17:17.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d691e7ae-6bd7-46bd-899d-e49f5a159802 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:17.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d691e7ae-6bd7-46bd-899d-e49f5a159802 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=948ad2fc-df23-46b6-99a5-4a2f4e047096 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=948ad2fc-df23-46b6-99a5-4a2f4e047096 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44c56767 2021-04-14T12:17:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=948ad2fc-df23-46b6-99a5-4a2f4e047096 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=948ad2fc-df23-46b6-99a5-4a2f4e047096 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=915edef2-00bb-4d94-9250-28855de529d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=915edef2-00bb-4d94-9250-28855de529d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12ee6e68 2021-04-14T12:17:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=915edef2-00bb-4d94-9250-28855de529d8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=915edef2-00bb-4d94-9250-28855de529d8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:24.334Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 404 Not Found 2021-04-14T12:17:24.334Z [TopicPollingThread-1] WARN c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Topic not found: /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:17:24.362Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:17:24.364Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:17:24.373Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:17:24.374Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:17:24.385Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:17:24.386Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:17:24.396Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:17:24.397Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06831a0-8b94-4fa7-a1ba-3f2daeb61a9e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06831a0-8b94-4fa7-a1ba-3f2daeb61a9e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6722fe2b 2021-04-14T12:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06831a0-8b94-4fa7-a1ba-3f2daeb61a9e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f06831a0-8b94-4fa7-a1ba-3f2daeb61a9e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:30.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea152e2-74e4-4845-84c1-724f73b1907c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:30.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea152e2-74e4-4845-84c1-724f73b1907c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f016e3d 2021-04-14T12:17:30.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea152e2-74e4-4845-84c1-724f73b1907c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:30.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea152e2-74e4-4845-84c1-724f73b1907c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:33.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ee809-08c7-45c5-b832-cb429c9583a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:33.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ee809-08c7-45c5-b832-cb429c9583a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1010d0e5 2021-04-14T12:17:33.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ee809-08c7-45c5-b832-cb429c9583a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:33.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=697ee809-08c7-45c5-b832-cb429c9583a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88a49ba7-c1c8-4ec0-a416-69f717eb56ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88a49ba7-c1c8-4ec0-a416-69f717eb56ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71ec61a1 2021-04-14T12:17:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88a49ba7-c1c8-4ec0-a416-69f717eb56ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88a49ba7-c1c8-4ec0-a416-69f717eb56ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:36.232Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5480996d-bc2b-4d14-9c11-bdaf61383ad7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:17:36.232319Z InvocationID=10bca852-6269-4530-838e-2da6dc6b255a LogTimestamp=2021-04-14T12:17:36.232393Z Entering 2021-04-14T12:17:36.232Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5480996d-bc2b-4d14-9c11-bdaf61383ad7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:17:36.232319Z InvocationID=10bca852-6269-4530-838e-2da6dc6b255a LogTimestamp=2021-04-14T12:17:36.232393Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:17:36.234Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:17:36.232Z InvocationID=7a4877f0-0aa9-4591-bdca-de1e0dfaea3f LogTimestamp=2021-04-14T12:17:36.234922Z ResponseDesc=OK Exiting. 2021-04-14T12:17:36.235Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:17:38.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06577e-b013-4b4b-956d-dc27ca8976ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:38.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06577e-b013-4b4b-956d-dc27ca8976ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14f1a11 2021-04-14T12:17:38.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06577e-b013-4b4b-956d-dc27ca8976ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:38.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06577e-b013-4b4b-956d-dc27ca8976ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd654dc1-2a81-4309-b533-74f60ec7a370 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd654dc1-2a81-4309-b533-74f60ec7a370 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75cbec83 2021-04-14T12:17:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd654dc1-2a81-4309-b533-74f60ec7a370 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd654dc1-2a81-4309-b533-74f60ec7a370 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9d91b7-2f81-404e-a9f1-f3c84b5579f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9d91b7-2f81-404e-a9f1-f3c84b5579f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63ca9d27 2021-04-14T12:17:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9d91b7-2f81-404e-a9f1-f3c84b5579f7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9d91b7-2f81-404e-a9f1-f3c84b5579f7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:47.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b6de5a9-3ea9-4b7f-9fef-9b8a4c98d7d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b6de5a9-3ea9-4b7f-9fef-9b8a4c98d7d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71391996 2021-04-14T12:17:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b6de5a9-3ea9-4b7f-9fef-9b8a4c98d7d8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b6de5a9-3ea9-4b7f-9fef-9b8a4c98d7d8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:48.234Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=473b95d5-7f30-4763-ba6a-dcd5317d9746 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:17:48.234119Z InvocationID=edc3aa2a-a166-4150-89ca-b40af4566077 LogTimestamp=2021-04-14T12:17:48.234205Z Entering 2021-04-14T12:17:48.234Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=473b95d5-7f30-4763-ba6a-dcd5317d9746 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:17:48.234119Z InvocationID=edc3aa2a-a166-4150-89ca-b40af4566077 LogTimestamp=2021-04-14T12:17:48.234205Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:17:48.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:17:48.234Z InvocationID=527d69ff-2ec7-468c-859f-9dc45eec25a8 LogTimestamp=2021-04-14T12:17:48.236176Z ResponseDesc=OK Exiting. 2021-04-14T12:17:48.236Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:17:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44517d8e-0f70-4c94-bb4c-33b5f8c657a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44517d8e-0f70-4c94-bb4c-33b5f8c657a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8df1a32 2021-04-14T12:17:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44517d8e-0f70-4c94-bb4c-33b5f8c657a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44517d8e-0f70-4c94-bb4c-33b5f8c657a7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a571c4d-32ce-4c7d-a02a-981c8e73da84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a571c4d-32ce-4c7d-a02a-981c8e73da84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22da405e 2021-04-14T12:17:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a571c4d-32ce-4c7d-a02a-981c8e73da84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a571c4d-32ce-4c7d-a02a-981c8e73da84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f02153-2e8f-4d9c-8f36-0f755bea38f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f02153-2e8f-4d9c-8f36-0f755bea38f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15ced287 2021-04-14T12:17:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f02153-2e8f-4d9c-8f36-0f755bea38f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63f02153-2e8f-4d9c-8f36-0f755bea38f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:17:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5166e6e1-6e7e-472f-92ad-5a00a97deac7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:17:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5166e6e1-6e7e-472f-92ad-5a00a97deac7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c829c01 2021-04-14T12:17:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5166e6e1-6e7e-472f-92ad-5a00a97deac7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:17:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5166e6e1-6e7e-472f-92ad-5a00a97deac7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f3ebb0-f224-4c56-964d-88df454b7809 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f3ebb0-f224-4c56-964d-88df454b7809 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c7c1d29 2021-04-14T12:18:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f3ebb0-f224-4c56-964d-88df454b7809 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68f3ebb0-f224-4c56-964d-88df454b7809 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:18:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:18:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b56f34d-cf6b-4d40-9741-921cde6665c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b56f34d-cf6b-4d40-9741-921cde6665c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cd46e48 2021-04-14T12:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b56f34d-cf6b-4d40-9741-921cde6665c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b56f34d-cf6b-4d40-9741-921cde6665c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:09.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=061df9ca-ab7b-4669-aaee-110271c629db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:09.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=061df9ca-ab7b-4669-aaee-110271c629db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f6dcbbf 2021-04-14T12:18:09.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=061df9ca-ab7b-4669-aaee-110271c629db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:09.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=061df9ca-ab7b-4669-aaee-110271c629db PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:11.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3af0cb1-ed27-49e4-901b-6e33da46c897 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:11.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3af0cb1-ed27-49e4-901b-6e33da46c897 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@773734c7 2021-04-14T12:18:11.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3af0cb1-ed27-49e4-901b-6e33da46c897 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:11.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3af0cb1-ed27-49e4-901b-6e33da46c897 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:13.204Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=43f98e66-65dd-4f7b-8a7b-b27e8c27d6e0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:18:13.204294Z InvocationID=c74f8981-fe1f-489c-8907-73896c3da23b LogTimestamp=2021-04-14T12:18:13.204348Z Entering 2021-04-14T12:18:13.204Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=43f98e66-65dd-4f7b-8a7b-b27e8c27d6e0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:18:13.204294Z InvocationID=c74f8981-fe1f-489c-8907-73896c3da23b LogTimestamp=2021-04-14T12:18:13.204348Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:18:13.205Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:18:13.204Z InvocationID=da1c2fd0-1fc4-49cb-a7d1-d5bd91afa179 LogTimestamp=2021-04-14T12:18:13.205574Z ResponseDesc=OK Exiting. 2021-04-14T12:18:13.205Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:18:14.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ba2ef1-1636-475d-b3fb-c2f4ac634957 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:14.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ba2ef1-1636-475d-b3fb-c2f4ac634957 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b9efa5d 2021-04-14T12:18:14.780Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ba2ef1-1636-475d-b3fb-c2f4ac634957 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ba2ef1-1636-475d-b3fb-c2f4ac634957 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77175d7-84f5-4f37-82f6-538d49937de2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77175d7-84f5-4f37-82f6-538d49937de2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44377b48 2021-04-14T12:18:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77175d7-84f5-4f37-82f6-538d49937de2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77175d7-84f5-4f37-82f6-538d49937de2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:20.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7fa2d6-8beb-46f4-acf8-621fc91551d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:20.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7fa2d6-8beb-46f4-acf8-621fc91551d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65267042 2021-04-14T12:18:20.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7fa2d6-8beb-46f4-acf8-621fc91551d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:20.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e7fa2d6-8beb-46f4-acf8-621fc91551d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac7fb53-b5a8-4847-9cee-0ab27ac4bf0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac7fb53-b5a8-4847-9cee-0ab27ac4bf0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b79e12d 2021-04-14T12:18:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac7fb53-b5a8-4847-9cee-0ab27ac4bf0a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cac7fb53-b5a8-4847-9cee-0ab27ac4bf0a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:27.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8ae74c-57a8-4e93-bbf4-dbdbd0423195 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:27.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8ae74c-57a8-4e93-bbf4-dbdbd0423195 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1789aa0d 2021-04-14T12:18:27.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8ae74c-57a8-4e93-bbf4-dbdbd0423195 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:27.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c8ae74c-57a8-4e93-bbf4-dbdbd0423195 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfc9717-ce13-4582-8fab-2cc08c1e8461 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfc9717-ce13-4582-8fab-2cc08c1e8461 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@689b7e8f 2021-04-14T12:18:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfc9717-ce13-4582-8fab-2cc08c1e8461 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dfc9717-ce13-4582-8fab-2cc08c1e8461 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95bba197-0782-419a-97b9-68b61520447f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95bba197-0782-419a-97b9-68b61520447f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e69a7be 2021-04-14T12:18:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95bba197-0782-419a-97b9-68b61520447f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:33.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95bba197-0782-419a-97b9-68b61520447f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0265890-0a29-4af8-b834-63f23c9b638b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0265890-0a29-4af8-b834-63f23c9b638b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a7d49d7 2021-04-14T12:18:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0265890-0a29-4af8-b834-63f23c9b638b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0265890-0a29-4af8-b834-63f23c9b638b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:38.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e1f1c8-dc96-4bba-9bb3-87677ee7f4b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:38.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e1f1c8-dc96-4bba-9bb3-87677ee7f4b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fe4957 2021-04-14T12:18:38.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e1f1c8-dc96-4bba-9bb3-87677ee7f4b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:38.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4e1f1c8-dc96-4bba-9bb3-87677ee7f4b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:39.571Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond 2021-04-14T12:18:39.571Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T12:18:39.572Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (org.apache.http.NoHttpResponseException) caught when processing request to {}->http://message-router.onap:3904: The target server failed to respond 2021-04-14T12:18:39.572Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T12:18:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3335e74-03bf-40d4-ab36-0993de0e72b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3335e74-03bf-40d4-ab36-0993de0e72b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33a230c1 2021-04-14T12:18:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3335e74-03bf-40d4-ab36-0993de0e72b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3335e74-03bf-40d4-ab36-0993de0e72b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:45.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab17694b-6cba-49ad-b76f-c408ece2e842 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:45.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab17694b-6cba-49ad-b76f-c408ece2e842 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4005255c 2021-04-14T12:18:45.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab17694b-6cba-49ad-b76f-c408ece2e842 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:45.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab17694b-6cba-49ad-b76f-c408ece2e842 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c44d7eb-5e3c-4279-a1df-2bab805ea3d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c44d7eb-5e3c-4279-a1df-2bab805ea3d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7006ef7a 2021-04-14T12:18:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c44d7eb-5e3c-4279-a1df-2bab805ea3d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c44d7eb-5e3c-4279-a1df-2bab805ea3d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f2c2ca-5d75-4daa-9ef7-b68f58b95c8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f2c2ca-5d75-4daa-9ef7-b68f58b95c8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c0a4dc 2021-04-14T12:18:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f2c2ca-5d75-4daa-9ef7-b68f58b95c8e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f2c2ca-5d75-4daa-9ef7-b68f58b95c8e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:54.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d10fa-eb26-4795-9a9b-57d79ace58f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d10fa-eb26-4795-9a9b-57d79ace58f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2046b87d 2021-04-14T12:18:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d10fa-eb26-4795-9a9b-57d79ace58f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d10fa-eb26-4795-9a9b-57d79ace58f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:56.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c2799c4-68df-423c-a698-64a70d00f2e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c2799c4-68df-423c-a698-64a70d00f2e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@490046ec 2021-04-14T12:18:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c2799c4-68df-423c-a698-64a70d00f2e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c2799c4-68df-423c-a698-64a70d00f2e6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:18:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5321ef2-8432-44db-9fbd-55fc0733b541 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:18:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5321ef2-8432-44db-9fbd-55fc0733b541 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e3a1d89 2021-04-14T12:18:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5321ef2-8432-44db-9fbd-55fc0733b541 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:18:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5321ef2-8432-44db-9fbd-55fc0733b541 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:03.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac9d038-a0fa-42fc-8818-ccdb3fd2ac37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:03.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac9d038-a0fa-42fc-8818-ccdb3fd2ac37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9dbaed6 2021-04-14T12:19:03.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac9d038-a0fa-42fc-8818-ccdb3fd2ac37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:03.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac9d038-a0fa-42fc-8818-ccdb3fd2ac37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd03725-b099-4f40-a618-d63f87f75da1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd03725-b099-4f40-a618-d63f87f75da1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ccb6ac0 2021-04-14T12:19:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd03725-b099-4f40-a618-d63f87f75da1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bd03725-b099-4f40-a618-d63f87f75da1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e27ccc-0e9d-4200-82cd-efa5d48d3b31 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e27ccc-0e9d-4200-82cd-efa5d48d3b31 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57377893 2021-04-14T12:19:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e27ccc-0e9d-4200-82cd-efa5d48d3b31 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5e27ccc-0e9d-4200-82cd-efa5d48d3b31 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d7623b8-ebcb-4a0e-8205-87b00230b210 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d7623b8-ebcb-4a0e-8205-87b00230b210 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9bfe1a9 2021-04-14T12:19:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d7623b8-ebcb-4a0e-8205-87b00230b210 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:12.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d7623b8-ebcb-4a0e-8205-87b00230b210 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:14.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b59ca041-b38a-4e3a-b571-9938977aa296 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b59ca041-b38a-4e3a-b571-9938977aa296 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d464356 2021-04-14T12:19:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b59ca041-b38a-4e3a-b571-9938977aa296 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b59ca041-b38a-4e3a-b571-9938977aa296 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0472d81-c773-4583-82ae-e98bb6505ff7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0472d81-c773-4583-82ae-e98bb6505ff7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a9caf54 2021-04-14T12:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0472d81-c773-4583-82ae-e98bb6505ff7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0472d81-c773-4583-82ae-e98bb6505ff7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:20.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2faf6e-b6f9-4a62-b2d3-b02ac2c6cee4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:20.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2faf6e-b6f9-4a62-b2d3-b02ac2c6cee4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7603af74 2021-04-14T12:19:20.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2faf6e-b6f9-4a62-b2d3-b02ac2c6cee4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:20.601Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e2faf6e-b6f9-4a62-b2d3-b02ac2c6cee4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85314259-78a2-4cd7-890d-1010aeaa29d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85314259-78a2-4cd7-890d-1010aeaa29d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c7aab4 2021-04-14T12:19:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85314259-78a2-4cd7-890d-1010aeaa29d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85314259-78a2-4cd7-890d-1010aeaa29d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:27.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6542bc42-e0e9-4165-ae69-aef8119f46a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:27.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6542bc42-e0e9-4165-ae69-aef8119f46a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f741509 2021-04-14T12:19:27.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6542bc42-e0e9-4165-ae69-aef8119f46a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:27.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6542bc42-e0e9-4165-ae69-aef8119f46a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653b425a-936e-4cf9-b13c-95a451b86409 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653b425a-936e-4cf9-b13c-95a451b86409 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10edf1bc 2021-04-14T12:19:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653b425a-936e-4cf9-b13c-95a451b86409 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:30.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=653b425a-936e-4cf9-b13c-95a451b86409 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:33.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99ef88f2-4208-49d1-abb7-c4a2b8b054d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:33.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99ef88f2-4208-49d1-abb7-c4a2b8b054d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b7e84da 2021-04-14T12:19:33.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99ef88f2-4208-49d1-abb7-c4a2b8b054d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:33.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99ef88f2-4208-49d1-abb7-c4a2b8b054d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e7a65-70f3-467f-9f67-565f07211340 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e7a65-70f3-467f-9f67-565f07211340 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4651030b 2021-04-14T12:19:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e7a65-70f3-467f-9f67-565f07211340 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e7a65-70f3-467f-9f67-565f07211340 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:39.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb1e638-8083-4a2f-a87f-bbe2f54d2d1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:39.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb1e638-8083-4a2f-a87f-bbe2f54d2d1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9428a95 2021-04-14T12:19:39.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb1e638-8083-4a2f-a87f-bbe2f54d2d1a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:39.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebb1e638-8083-4a2f-a87f-bbe2f54d2d1a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:41.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6194f991-77aa-4b26-a28a-aa69ffaf88d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:41.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6194f991-77aa-4b26-a28a-aa69ffaf88d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@765dea10 2021-04-14T12:19:41.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6194f991-77aa-4b26-a28a-aa69ffaf88d2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:41.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6194f991-77aa-4b26-a28a-aa69ffaf88d2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cf8ae62-804f-4fdb-98a4-1e4713ca6e1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cf8ae62-804f-4fdb-98a4-1e4713ca6e1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@790af855 2021-04-14T12:19:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cf8ae62-804f-4fdb-98a4-1e4713ca6e1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cf8ae62-804f-4fdb-98a4-1e4713ca6e1d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4098d6-e68e-41ca-b8cc-e1337eef0d74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4098d6-e68e-41ca-b8cc-e1337eef0d74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@378df524 2021-04-14T12:19:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4098d6-e68e-41ca-b8cc-e1337eef0d74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb4098d6-e68e-41ca-b8cc-e1337eef0d74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a52a975-5a29-4f94-91b2-45c50b2154b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a52a975-5a29-4f94-91b2-45c50b2154b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a06c762 2021-04-14T12:19:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a52a975-5a29-4f94-91b2-45c50b2154b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a52a975-5a29-4f94-91b2-45c50b2154b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7683cda-6389-4112-9f99-bb476faca3d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7683cda-6389-4112-9f99-bb476faca3d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3312b558 2021-04-14T12:19:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7683cda-6389-4112-9f99-bb476faca3d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7683cda-6389-4112-9f99-bb476faca3d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:57.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94437cad-2c60-412a-9278-d34f2cf7a44e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:57.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94437cad-2c60-412a-9278-d34f2cf7a44e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d743b3f 2021-04-14T12:19:57.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94437cad-2c60-412a-9278-d34f2cf7a44e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:57.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94437cad-2c60-412a-9278-d34f2cf7a44e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:19:59.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f183b7a-e81a-4935-ab18-5be5293ca1ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:19:59.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f183b7a-e81a-4935-ab18-5be5293ca1ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4508c960 2021-04-14T12:19:59.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f183b7a-e81a-4935-ab18-5be5293ca1ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:19:59.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f183b7a-e81a-4935-ab18-5be5293ca1ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5476f42b-e478-4759-9e93-3ed9196174dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5476f42b-e478-4759-9e93-3ed9196174dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59a92b74 2021-04-14T12:20:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5476f42b-e478-4759-9e93-3ed9196174dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5476f42b-e478-4759-9e93-3ed9196174dd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40342e3e-611f-45f8-ad76-566fd82e8d6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40342e3e-611f-45f8-ad76-566fd82e8d6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f37fd6c 2021-04-14T12:20:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40342e3e-611f-45f8-ad76-566fd82e8d6d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40342e3e-611f-45f8-ad76-566fd82e8d6d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12b1e9ec-ef78-45ab-8952-55b372c598d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12b1e9ec-ef78-45ab-8952-55b372c598d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43268c76 2021-04-14T12:20:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12b1e9ec-ef78-45ab-8952-55b372c598d8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12b1e9ec-ef78-45ab-8952-55b372c598d8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:12.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca7f88e5-1c04-4531-83ef-a7b20f158cd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:12.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca7f88e5-1c04-4531-83ef-a7b20f158cd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40660ebb 2021-04-14T12:20:12.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca7f88e5-1c04-4531-83ef-a7b20f158cd0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:12.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ca7f88e5-1c04-4531-83ef-a7b20f158cd0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:14.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a138e23-4b40-479d-8854-4323f760d196 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:14.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a138e23-4b40-479d-8854-4323f760d196 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50047f48 2021-04-14T12:20:14.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a138e23-4b40-479d-8854-4323f760d196 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:14.615Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a138e23-4b40-479d-8854-4323f760d196 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b14bb7-6b66-411d-9be3-5e4633b2d94e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b14bb7-6b66-411d-9be3-5e4633b2d94e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@109824b9 2021-04-14T12:20:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b14bb7-6b66-411d-9be3-5e4633b2d94e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:17.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24b14bb7-6b66-411d-9be3-5e4633b2d94e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72a60a21-a32c-4a13-9ff7-19fbac3615a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72a60a21-a32c-4a13-9ff7-19fbac3615a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67aa4fe0 2021-04-14T12:20:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72a60a21-a32c-4a13-9ff7-19fbac3615a9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72a60a21-a32c-4a13-9ff7-19fbac3615a9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1faba2c5-de24-4d60-a06b-309430890996 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1faba2c5-de24-4d60-a06b-309430890996 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17c99678 2021-04-14T12:20:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1faba2c5-de24-4d60-a06b-309430890996 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1faba2c5-de24-4d60-a06b-309430890996 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:27.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ceb538-add3-41a9-9acb-d9020681d1be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:27.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ceb538-add3-41a9-9acb-d9020681d1be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64c445f6 2021-04-14T12:20:27.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ceb538-add3-41a9-9acb-d9020681d1be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:27.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5ceb538-add3-41a9-9acb-d9020681d1be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:29.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31aa1012-9c3c-4938-a679-3ce029df035c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:29.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31aa1012-9c3c-4938-a679-3ce029df035c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3528183b 2021-04-14T12:20:29.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31aa1012-9c3c-4938-a679-3ce029df035c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:29.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31aa1012-9c3c-4938-a679-3ce029df035c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2fea28-345f-41ce-8250-1eecef8733ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2fea28-345f-41ce-8250-1eecef8733ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@488431 2021-04-14T12:20:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2fea28-345f-41ce-8250-1eecef8733ff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d2fea28-345f-41ce-8250-1eecef8733ff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:34.611Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04in9skmvg1id13mpfv2nd795w235 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xpbbjg3l8gq6wbf0rlr5a4vo231 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node058qgyq64unii1o2ny79kx2ux222 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01f3buvyep87ye1fqo4mxnlyrpx239 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0uf4124kfcy4310o1h8m4211ls242 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qnho84ptgjmg1irbrae8p0sww234 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0h4k2adzkbkp0qcu03po5h32q247 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01c70qh9w5ws7fus5xzvh3dhig237 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01f16z86tk0itg16poh2elsbyn8250 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04z3c6kghyuhn1e6z8tgmb2uwi228 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0wr5lz5s9elov1g60qqowydmz8241 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01go7otgj2aj8t7nvb78gwxrk8240 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0m3jfewibbnguyb9jkjj1qzf7248 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01l185cf407cf8123ojm2tq6jo6226 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lgu6agrhci9f16vgfkgyhmtp6227 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0i1ogir9hjrd5gmz6xzayns9e225 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0thk0qzugl3o1pw75urp9bzyz246 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0lct9a2axdfv61230mbyy7ph5232 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ekd1xiu5qblv1b2m8h8ricll2249 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0c1y3j53gfsmr5488sqgqqcsv224 2021-04-14T12:20:34.612Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04q03at2dnumdriec63iwftr9236 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0198ed31cmvafo1dnhx9py0v7zl223 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0uobua0azfgm516dd2lntojma7233 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01kcvivwiqkwrwsg8suc05bd0g245 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013f7b8s25d2nt1xe84z3v2gtw7230 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0cuc4qg5tptg4cbk9x5dg9yx7243 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04u3q040e7m8j1maiaw5qa2kv6229 2021-04-14T12:20:34.613Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s9jkjk1oej761e38d4wwizp6r244 2021-04-14T12:20:36.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cea4270-ef9e-4732-bd9d-51db402a9d20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:36.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cea4270-ef9e-4732-bd9d-51db402a9d20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5be9b816 2021-04-14T12:20:36.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cea4270-ef9e-4732-bd9d-51db402a9d20 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:36.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0cea4270-ef9e-4732-bd9d-51db402a9d20 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:39.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223e6fdc-08f0-442d-b9bb-1f29569cef93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:39.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223e6fdc-08f0-442d-b9bb-1f29569cef93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d44ad68 2021-04-14T12:20:39.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223e6fdc-08f0-442d-b9bb-1f29569cef93 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:39.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=223e6fdc-08f0-442d-b9bb-1f29569cef93 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:41.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8067e827-ddec-4936-b809-74580be6ee78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:41.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8067e827-ddec-4936-b809-74580be6ee78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d8873b 2021-04-14T12:20:41.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8067e827-ddec-4936-b809-74580be6ee78 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:41.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8067e827-ddec-4936-b809-74580be6ee78 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:44.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e15b5584-ab28-4940-a4de-44fed7fc1446 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:44.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e15b5584-ab28-4940-a4de-44fed7fc1446 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c75ef1d 2021-04-14T12:20:44.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e15b5584-ab28-4940-a4de-44fed7fc1446 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:44.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e15b5584-ab28-4940-a4de-44fed7fc1446 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:47.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539be75b-f112-4aa6-8118-97cacbdf2b37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:47.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539be75b-f112-4aa6-8118-97cacbdf2b37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a4adb8d 2021-04-14T12:20:47.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539be75b-f112-4aa6-8118-97cacbdf2b37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:47.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=539be75b-f112-4aa6-8118-97cacbdf2b37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:51.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e83663-d5b7-45d4-bbcd-4bade40541ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:51.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e83663-d5b7-45d4-bbcd-4bade40541ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25d0e41 2021-04-14T12:20:51.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e83663-d5b7-45d4-bbcd-4bade40541ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:51.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e83663-d5b7-45d4-bbcd-4bade40541ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9c2986-1ca5-45e6-8e36-88ba32928979 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9c2986-1ca5-45e6-8e36-88ba32928979 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e10a06e 2021-04-14T12:20:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9c2986-1ca5-45e6-8e36-88ba32928979 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce9c2986-1ca5-45e6-8e36-88ba32928979 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:56.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5627c762-282c-41e2-aff9-bab3fadb2572 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5627c762-282c-41e2-aff9-bab3fadb2572 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d1eafb6 2021-04-14T12:20:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5627c762-282c-41e2-aff9-bab3fadb2572 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:56.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5627c762-282c-41e2-aff9-bab3fadb2572 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:20:59.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37bc9149-ed83-49bb-9947-eb4a72e7cfa4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:20:59.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37bc9149-ed83-49bb-9947-eb4a72e7cfa4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41648f2b 2021-04-14T12:20:59.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37bc9149-ed83-49bb-9947-eb4a72e7cfa4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:20:59.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37bc9149-ed83-49bb-9947-eb4a72e7cfa4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f8b07e-999b-4ed3-81bb-090c39fe4608 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f8b07e-999b-4ed3-81bb-090c39fe4608 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b21be40 2021-04-14T12:21:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f8b07e-999b-4ed3-81bb-090c39fe4608 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88f8b07e-999b-4ed3-81bb-090c39fe4608 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:06.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bb97a5-b6e5-425a-93bb-19f161b43839 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:06.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bb97a5-b6e5-425a-93bb-19f161b43839 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@99689a 2021-04-14T12:21:06.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bb97a5-b6e5-425a-93bb-19f161b43839 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:06.217Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1bb97a5-b6e5-425a-93bb-19f161b43839 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4614ddb-51df-4919-a0e5-aa39458e3ecd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4614ddb-51df-4919-a0e5-aa39458e3ecd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58221420 2021-04-14T12:21:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4614ddb-51df-4919-a0e5-aa39458e3ecd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4614ddb-51df-4919-a0e5-aa39458e3ecd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c8caefb-78aa-4605-b58e-01501f6c215b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c8caefb-78aa-4605-b58e-01501f6c215b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ddac5d8 2021-04-14T12:21:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c8caefb-78aa-4605-b58e-01501f6c215b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c8caefb-78aa-4605-b58e-01501f6c215b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efc84d4e-6f7f-4929-a632-e56b98127a3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efc84d4e-6f7f-4929-a632-e56b98127a3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bafaf9d 2021-04-14T12:21:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efc84d4e-6f7f-4929-a632-e56b98127a3e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=efc84d4e-6f7f-4929-a632-e56b98127a3e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:17.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243345e9-a7da-4f9e-bdd8-e183195c82b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:17.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243345e9-a7da-4f9e-bdd8-e183195c82b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50b9d9ca 2021-04-14T12:21:17.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243345e9-a7da-4f9e-bdd8-e183195c82b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:17.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=243345e9-a7da-4f9e-bdd8-e183195c82b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55e13da4-45ba-49ba-9091-65a442f4b25b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55e13da4-45ba-49ba-9091-65a442f4b25b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18f244e9 2021-04-14T12:21:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55e13da4-45ba-49ba-9091-65a442f4b25b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55e13da4-45ba-49ba-9091-65a442f4b25b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:24.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbada015-2132-40a6-b1e4-35d4613ed708 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:24.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbada015-2132-40a6-b1e4-35d4613ed708 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73eda62a 2021-04-14T12:21:24.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbada015-2132-40a6-b1e4-35d4613ed708 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:24.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbada015-2132-40a6-b1e4-35d4613ed708 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f07880-2f7c-47b4-b72d-3d53b3d2c951 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f07880-2f7c-47b4-b72d-3d53b3d2c951 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15d83c8d 2021-04-14T12:21:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f07880-2f7c-47b4-b72d-3d53b3d2c951 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35f07880-2f7c-47b4-b72d-3d53b3d2c951 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:30.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6932faae-676c-437b-b746-01a426f9f5f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:30.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6932faae-676c-437b-b746-01a426f9f5f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b31d075 2021-04-14T12:21:30.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6932faae-676c-437b-b746-01a426f9f5f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:30.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6932faae-676c-437b-b746-01a426f9f5f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02fe014e-4bb7-4afb-b86e-4054ac93c35d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02fe014e-4bb7-4afb-b86e-4054ac93c35d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee08f6 2021-04-14T12:21:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02fe014e-4bb7-4afb-b86e-4054ac93c35d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02fe014e-4bb7-4afb-b86e-4054ac93c35d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:35.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900531-faf6-4426-a627-d85f7694d54c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:35.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900531-faf6-4426-a627-d85f7694d54c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f2c2217 2021-04-14T12:21:35.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900531-faf6-4426-a627-d85f7694d54c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:35.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23900531-faf6-4426-a627-d85f7694d54c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:39.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=077e6c2c-41ca-4683-8d23-e86e84ca494b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:39.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=077e6c2c-41ca-4683-8d23-e86e84ca494b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b44492b 2021-04-14T12:21:39.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=077e6c2c-41ca-4683-8d23-e86e84ca494b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:39.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=077e6c2c-41ca-4683-8d23-e86e84ca494b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0f55d3-78c1-4e3c-8a5e-13cdd7d30455 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0f55d3-78c1-4e3c-8a5e-13cdd7d30455 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e738a4e 2021-04-14T12:21:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0f55d3-78c1-4e3c-8a5e-13cdd7d30455 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b0f55d3-78c1-4e3c-8a5e-13cdd7d30455 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16581742-1bbd-4ff8-a760-31a61b1f692a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16581742-1bbd-4ff8-a760-31a61b1f692a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fab82ce 2021-04-14T12:21:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16581742-1bbd-4ff8-a760-31a61b1f692a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16581742-1bbd-4ff8-a760-31a61b1f692a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1305227-2d42-4609-bfea-044400f623c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1305227-2d42-4609-bfea-044400f623c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41e933b6 2021-04-14T12:21:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1305227-2d42-4609-bfea-044400f623c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1305227-2d42-4609-bfea-044400f623c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:51.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2b7a8b3-9d7e-4cae-9291-f156ffb6f849 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2b7a8b3-9d7e-4cae-9291-f156ffb6f849 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@288d37b1 2021-04-14T12:21:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2b7a8b3-9d7e-4cae-9291-f156ffb6f849 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2b7a8b3-9d7e-4cae-9291-f156ffb6f849 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:54.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b064e956-720b-4a38-aac8-b78463d4c4d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:54.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b064e956-720b-4a38-aac8-b78463d4c4d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7afef914 2021-04-14T12:21:54.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b064e956-720b-4a38-aac8-b78463d4c4d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:54.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b064e956-720b-4a38-aac8-b78463d4c4d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=050961d8-71f2-430a-8612-5fa01a55e415 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=050961d8-71f2-430a-8612-5fa01a55e415 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19a0a977 2021-04-14T12:21:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=050961d8-71f2-430a-8612-5fa01a55e415 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=050961d8-71f2-430a-8612-5fa01a55e415 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:21:59.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b10feb-d043-45de-b06d-4394bbbf9eb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:21:59.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b10feb-d043-45de-b06d-4394bbbf9eb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@115c5d76 2021-04-14T12:21:59.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b10feb-d043-45de-b06d-4394bbbf9eb7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:21:59.587Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b10feb-d043-45de-b06d-4394bbbf9eb7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:03.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=970a72c5-d349-47ad-b5a3-0dc6e57c7178 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=970a72c5-d349-47ad-b5a3-0dc6e57c7178 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50adc053 2021-04-14T12:22:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=970a72c5-d349-47ad-b5a3-0dc6e57c7178 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=970a72c5-d349-47ad-b5a3-0dc6e57c7178 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:04.656Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5c5fcaef-5b8d-41ff-9325-30e938ff843f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:22:04.655555Z InvocationID=b40d8002-e1dd-432a-8ec9-89810d62124a LogTimestamp=2021-04-14T12:22:04.655748Z Entering 2021-04-14T12:22:04.656Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5c5fcaef-5b8d-41ff-9325-30e938ff843f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:22:04.655555Z InvocationID=b40d8002-e1dd-432a-8ec9-89810d62124a LogTimestamp=2021-04-14T12:22:04.655748Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:22:04.660Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:22:04.657Z InvocationID=8b67388c-6830-4cc0-8749-0b76e4a8edfc LogTimestamp=2021-04-14T12:22:04.660379Z ResponseDesc=OK Exiting. 2021-04-14T12:22:04.660Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:22:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eece2fe-8991-4564-a3f8-dc26db4f7b7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eece2fe-8991-4564-a3f8-dc26db4f7b7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d96a50b 2021-04-14T12:22:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eece2fe-8991-4564-a3f8-dc26db4f7b7f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4eece2fe-8991-4564-a3f8-dc26db4f7b7f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa82609-d181-4b57-a0cd-cd1d4acee778 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa82609-d181-4b57-a0cd-cd1d4acee778 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@416154df 2021-04-14T12:22:08.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa82609-d181-4b57-a0cd-cd1d4acee778 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:08.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fa82609-d181-4b57-a0cd-cd1d4acee778 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:12.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a846f1-0fb9-4478-a37d-b7228192e113 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:12.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a846f1-0fb9-4478-a37d-b7228192e113 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32a50668 2021-04-14T12:22:12.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a846f1-0fb9-4478-a37d-b7228192e113 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:12.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29a846f1-0fb9-4478-a37d-b7228192e113 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:14.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d26aa96-31c7-40f9-843c-c90dc5d9b6bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:14.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d26aa96-31c7-40f9-843c-c90dc5d9b6bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c34f737 2021-04-14T12:22:14.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d26aa96-31c7-40f9-843c-c90dc5d9b6bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:14.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d26aa96-31c7-40f9-843c-c90dc5d9b6bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:17.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85fd311-72e9-4294-80af-346ddc784e14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:17.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85fd311-72e9-4294-80af-346ddc784e14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6462b547 2021-04-14T12:22:17.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85fd311-72e9-4294-80af-346ddc784e14 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:17.793Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a85fd311-72e9-4294-80af-346ddc784e14 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58860b3-7c46-4ce2-a59c-4700ba2e7646 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58860b3-7c46-4ce2-a59c-4700ba2e7646 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2feec2b8 2021-04-14T12:22:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58860b3-7c46-4ce2-a59c-4700ba2e7646 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c58860b3-7c46-4ce2-a59c-4700ba2e7646 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e067cd4-b6e8-4192-86ff-ec3387e6c41b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e067cd4-b6e8-4192-86ff-ec3387e6c41b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3562076b 2021-04-14T12:22:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e067cd4-b6e8-4192-86ff-ec3387e6c41b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e067cd4-b6e8-4192-86ff-ec3387e6c41b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71be1fed-9cf4-4058-94d7-f516e37a7956 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71be1fed-9cf4-4058-94d7-f516e37a7956 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e44d3bf 2021-04-14T12:22:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71be1fed-9cf4-4058-94d7-f516e37a7956 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71be1fed-9cf4-4058-94d7-f516e37a7956 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9506712f-f478-441c-8007-b4bdac2aa552 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9506712f-f478-441c-8007-b4bdac2aa552 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f7d95bd 2021-04-14T12:22:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9506712f-f478-441c-8007-b4bdac2aa552 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9506712f-f478-441c-8007-b4bdac2aa552 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d624b12-4c86-4615-b259-0be0efdd1d19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d624b12-4c86-4615-b259-0be0efdd1d19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@365f71e8 2021-04-14T12:22:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d624b12-4c86-4615-b259-0be0efdd1d19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:33.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d624b12-4c86-4615-b259-0be0efdd1d19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:35.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8745a1fc-6d75-49c1-bb5c-7570d3a32823 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:35.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8745a1fc-6d75-49c1-bb5c-7570d3a32823 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13a37117 2021-04-14T12:22:35.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8745a1fc-6d75-49c1-bb5c-7570d3a32823 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:35.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8745a1fc-6d75-49c1-bb5c-7570d3a32823 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:39.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deba948d-9879-46af-a857-170037083347 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:39.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deba948d-9879-46af-a857-170037083347 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b4291f7 2021-04-14T12:22:39.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deba948d-9879-46af-a857-170037083347 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:39.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=deba948d-9879-46af-a857-170037083347 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790606fa-4044-4031-ab10-82aba29a45ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790606fa-4044-4031-ab10-82aba29a45ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2891295f 2021-04-14T12:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790606fa-4044-4031-ab10-82aba29a45ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=790606fa-4044-4031-ab10-82aba29a45ac PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f55bc6-78f7-448a-ad52-f8d879e22fc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f55bc6-78f7-448a-ad52-f8d879e22fc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@658cdd94 2021-04-14T12:22:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f55bc6-78f7-448a-ad52-f8d879e22fc7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:45.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f55bc6-78f7-448a-ad52-f8d879e22fc7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c06542f-47e6-41ec-9763-864415147025 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c06542f-47e6-41ec-9763-864415147025 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d2f33fb 2021-04-14T12:22:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c06542f-47e6-41ec-9763-864415147025 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c06542f-47e6-41ec-9763-864415147025 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0348c502-d3a3-4d41-898d-472df0e9033f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0348c502-d3a3-4d41-898d-472df0e9033f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@525dca80 2021-04-14T12:22:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0348c502-d3a3-4d41-898d-472df0e9033f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0348c502-d3a3-4d41-898d-472df0e9033f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b1d8b30-f753-41fe-83dd-2f8a4852c258 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b1d8b30-f753-41fe-83dd-2f8a4852c258 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73a7ca45 2021-04-14T12:22:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b1d8b30-f753-41fe-83dd-2f8a4852c258 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b1d8b30-f753-41fe-83dd-2f8a4852c258 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:57.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59640092-443a-4e03-bf4d-4dfe89f79031 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:57.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59640092-443a-4e03-bf4d-4dfe89f79031 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70c4d9d8 2021-04-14T12:22:57.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59640092-443a-4e03-bf4d-4dfe89f79031 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:57.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59640092-443a-4e03-bf4d-4dfe89f79031 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:22:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2763f22e-4817-46e4-8734-ec91fde6a966 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:22:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2763f22e-4817-46e4-8734-ec91fde6a966 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64e08cd0 2021-04-14T12:22:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2763f22e-4817-46e4-8734-ec91fde6a966 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:22:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2763f22e-4817-46e4-8734-ec91fde6a966 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42d42ceb-0405-4e21-b8a0-50746267c9d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42d42ceb-0405-4e21-b8a0-50746267c9d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58555306 2021-04-14T12:23:02.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42d42ceb-0405-4e21-b8a0-50746267c9d0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:02.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42d42ceb-0405-4e21-b8a0-50746267c9d0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423f7b2e-8b5a-47fb-a4b0-3af0a77d680f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423f7b2e-8b5a-47fb-a4b0-3af0a77d680f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15ed4fab 2021-04-14T12:23:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423f7b2e-8b5a-47fb-a4b0-3af0a77d680f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423f7b2e-8b5a-47fb-a4b0-3af0a77d680f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:08.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f3f72-5272-4164-8e5c-aa819b1a30ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:08.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f3f72-5272-4164-8e5c-aa819b1a30ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43b15ed7 2021-04-14T12:23:08.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f3f72-5272-4164-8e5c-aa819b1a30ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:08.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f3f72-5272-4164-8e5c-aa819b1a30ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bfabce1-e2cd-40a3-8ce3-5fb3764860f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bfabce1-e2cd-40a3-8ce3-5fb3764860f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23d7dc7d 2021-04-14T12:23:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bfabce1-e2cd-40a3-8ce3-5fb3764860f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bfabce1-e2cd-40a3-8ce3-5fb3764860f1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b435192-76c8-4357-bf53-6375b4c68eee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b435192-76c8-4357-bf53-6375b4c68eee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51e86662 2021-04-14T12:23:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b435192-76c8-4357-bf53-6375b4c68eee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b435192-76c8-4357-bf53-6375b4c68eee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b703ddd3-7fbd-43d7-8c7d-b5c4143062fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b703ddd3-7fbd-43d7-8c7d-b5c4143062fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e07ebe3 2021-04-14T12:23:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b703ddd3-7fbd-43d7-8c7d-b5c4143062fc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b703ddd3-7fbd-43d7-8c7d-b5c4143062fc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d409610-cdb3-458c-bd5d-c09b3642ba59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d409610-cdb3-458c-bd5d-c09b3642ba59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67894f12 2021-04-14T12:23:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d409610-cdb3-458c-bd5d-c09b3642ba59 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d409610-cdb3-458c-bd5d-c09b3642ba59 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:22.353Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=319a2f76-af47-4776-8a4f-30adba03edc4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:23:22.352866Z InvocationID=a4b9dafb-4ab1-4c3c-828e-f1ee799567b3 LogTimestamp=2021-04-14T12:23:22.352983Z Entering 2021-04-14T12:23:22.353Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=319a2f76-af47-4776-8a4f-30adba03edc4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:23:22.352866Z InvocationID=a4b9dafb-4ab1-4c3c-828e-f1ee799567b3 LogTimestamp=2021-04-14T12:23:22.352983Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:23:22.357Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:23:22.353Z InvocationID=659219b1-074e-402f-b1c3-747c744d519e LogTimestamp=2021-04-14T12:23:22.356910Z ResponseDesc=OK Exiting. 2021-04-14T12:23:22.357Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:23:22.537Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T12:23:22.537Z [TopicPollingThread-1] INFO o.a.http.impl.execchain.RetryExec RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Retrying request to {}->http://message-router.onap:3904 2021-04-14T12:23:22.541Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec I/O exception (java.net.SocketException) caught when processing request to {}->http://message-router.onap:3904: Connection reset 2021-04-14T12:23:22.541Z [UEB-Health-Check-Thread] INFO o.a.http.impl.execchain.RetryExec Retrying request to {}->http://message-router.onap:3904 2021-04-14T12:23:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5adc2206-8ec7-460b-842a-de06cd3c14a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5adc2206-8ec7-460b-842a-de06cd3c14a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aa053aa 2021-04-14T12:23:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5adc2206-8ec7-460b-842a-de06cd3c14a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5adc2206-8ec7-460b-842a-de06cd3c14a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:27.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e879e132-bedc-4c04-bb57-2f271d939379 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:27.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e879e132-bedc-4c04-bb57-2f271d939379 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6869e1ea 2021-04-14T12:23:27.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e879e132-bedc-4c04-bb57-2f271d939379 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:27.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e879e132-bedc-4c04-bb57-2f271d939379 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a5539d4-6dfc-45bf-b076-1a11c7a7e5d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a5539d4-6dfc-45bf-b076-1a11c7a7e5d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@792057f7 2021-04-14T12:23:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a5539d4-6dfc-45bf-b076-1a11c7a7e5d5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:30.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a5539d4-6dfc-45bf-b076-1a11c7a7e5d5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:33.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fafd9d40-59d4-4682-bb8e-31ce8d2683c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:33.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fafd9d40-59d4-4682-bb8e-31ce8d2683c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@547c661e 2021-04-14T12:23:33.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fafd9d40-59d4-4682-bb8e-31ce8d2683c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:33.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fafd9d40-59d4-4682-bb8e-31ce8d2683c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de66faf0-ef7c-49c4-9e83-b3312fe11d19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de66faf0-ef7c-49c4-9e83-b3312fe11d19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cb95238 2021-04-14T12:23:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de66faf0-ef7c-49c4-9e83-b3312fe11d19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de66faf0-ef7c-49c4-9e83-b3312fe11d19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d1b033-39c5-4bde-8033-fafc8a253000 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d1b033-39c5-4bde-8033-fafc8a253000 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b7890f4 2021-04-14T12:23:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d1b033-39c5-4bde-8033-fafc8a253000 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:39.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d1b033-39c5-4bde-8033-fafc8a253000 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46aadc11-2361-4c7b-a1c1-b64a24663383 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46aadc11-2361-4c7b-a1c1-b64a24663383 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@701ce183 2021-04-14T12:23:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46aadc11-2361-4c7b-a1c1-b64a24663383 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46aadc11-2361-4c7b-a1c1-b64a24663383 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1804bb-56cd-4c79-8a18-8db4d976870e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1804bb-56cd-4c79-8a18-8db4d976870e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47e72508 2021-04-14T12:23:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1804bb-56cd-4c79-8a18-8db4d976870e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:45.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1804bb-56cd-4c79-8a18-8db4d976870e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:47.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=332173ad-ba06-4bcd-83a7-c4c21c2ede09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:47.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=332173ad-ba06-4bcd-83a7-c4c21c2ede09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21a9975e 2021-04-14T12:23:47.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=332173ad-ba06-4bcd-83a7-c4c21c2ede09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:47.905Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=332173ad-ba06-4bcd-83a7-c4c21c2ede09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:48.198Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f75fab93-6201-4389-a016-8cf4c344afb2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:23:48.198275Z InvocationID=c1f4e3b6-5498-4642-a77f-053766b7b661 LogTimestamp=2021-04-14T12:23:48.198393Z Entering 2021-04-14T12:23:48.198Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f75fab93-6201-4389-a016-8cf4c344afb2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:23:48.198275Z InvocationID=c1f4e3b6-5498-4642-a77f-053766b7b661 LogTimestamp=2021-04-14T12:23:48.198393Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:23:48.200Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:23:48.199Z InvocationID=8cec5031-b147-4852-bc4e-44af9e4d10db LogTimestamp=2021-04-14T12:23:48.200850Z ResponseDesc=OK Exiting. 2021-04-14T12:23:48.201Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:23:51.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e35a901-bf02-461e-b765-f8da2b37e508 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:51.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e35a901-bf02-461e-b765-f8da2b37e508 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e995caf 2021-04-14T12:23:51.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e35a901-bf02-461e-b765-f8da2b37e508 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:51.228Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e35a901-bf02-461e-b765-f8da2b37e508 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad7e51bd-d235-4184-ad34-a1ceae253687 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad7e51bd-d235-4184-ad34-a1ceae253687 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@799ea806 2021-04-14T12:23:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad7e51bd-d235-4184-ad34-a1ceae253687 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad7e51bd-d235-4184-ad34-a1ceae253687 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e979d4f7-8168-4123-8cdf-c29d01fe8d19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e979d4f7-8168-4123-8cdf-c29d01fe8d19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72f1d58 2021-04-14T12:23:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e979d4f7-8168-4123-8cdf-c29d01fe8d19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e979d4f7-8168-4123-8cdf-c29d01fe8d19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:23:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb985e33-519d-46fa-83a9-0f073afd37ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:23:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb985e33-519d-46fa-83a9-0f073afd37ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a517984 2021-04-14T12:23:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb985e33-519d-46fa-83a9-0f073afd37ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:23:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb985e33-519d-46fa-83a9-0f073afd37ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:03.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af7d66-8ff4-4204-a821-a91b57383ebb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:03.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af7d66-8ff4-4204-a821-a91b57383ebb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e093c45 2021-04-14T12:24:03.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af7d66-8ff4-4204-a821-a91b57383ebb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:03.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23af7d66-8ff4-4204-a821-a91b57383ebb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de81a133-6579-4890-befe-556b53af8b59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:06.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de81a133-6579-4890-befe-556b53af8b59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42db631a 2021-04-14T12:24:06.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de81a133-6579-4890-befe-556b53af8b59 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:06.200Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de81a133-6579-4890-befe-556b53af8b59 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:06.630Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0e6459b3-4d75-4237-a22f-dbaf871d4099 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:24:06.629756Z InvocationID=3d26325f-b86b-4b58-b527-89768308b1fe LogTimestamp=2021-04-14T12:24:06.629832Z Entering 2021-04-14T12:24:06.630Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0e6459b3-4d75-4237-a22f-dbaf871d4099 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:24:06.629756Z InvocationID=3d26325f-b86b-4b58-b527-89768308b1fe LogTimestamp=2021-04-14T12:24:06.629832Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:24:06.633Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:24:06.630Z InvocationID=20f41a64-215d-472d-9911-0b7b32fc2e26 LogTimestamp=2021-04-14T12:24:06.632972Z ResponseDesc=OK Exiting. 2021-04-14T12:24:06.633Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:24:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49fbe1d-61fc-4941-ab31-7073d3dcb267 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49fbe1d-61fc-4941-ab31-7073d3dcb267 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3de163c4 2021-04-14T12:24:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49fbe1d-61fc-4941-ab31-7073d3dcb267 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49fbe1d-61fc-4941-ab31-7073d3dcb267 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668f9e14-ea20-4c58-86b5-6d65f4d628b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668f9e14-ea20-4c58-86b5-6d65f4d628b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c1da0a5 2021-04-14T12:24:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668f9e14-ea20-4c58-86b5-6d65f4d628b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=668f9e14-ea20-4c58-86b5-6d65f4d628b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:14.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae8d71ec-0656-4a4c-ae47-bb3c44d6e73d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:14.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae8d71ec-0656-4a4c-ae47-bb3c44d6e73d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b715477 2021-04-14T12:24:14.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae8d71ec-0656-4a4c-ae47-bb3c44d6e73d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:14.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae8d71ec-0656-4a4c-ae47-bb3c44d6e73d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35280ec-96bb-413c-858c-a2bce13638f1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35280ec-96bb-413c-858c-a2bce13638f1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ab3fb0 2021-04-14T12:24:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35280ec-96bb-413c-858c-a2bce13638f1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:17.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35280ec-96bb-413c-858c-a2bce13638f1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:20.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28248b3-605a-4bdb-8367-e1e65ff7e6cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:20.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28248b3-605a-4bdb-8367-e1e65ff7e6cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74629b62 2021-04-14T12:24:20.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28248b3-605a-4bdb-8367-e1e65ff7e6cd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:20.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a28248b3-605a-4bdb-8367-e1e65ff7e6cd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8be55afb-b87e-4ea7-b243-8491098a32ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8be55afb-b87e-4ea7-b243-8491098a32ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45cb15c3 2021-04-14T12:24:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8be55afb-b87e-4ea7-b243-8491098a32ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8be55afb-b87e-4ea7-b243-8491098a32ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06873f69-1e16-4343-a63a-916fb17cead1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06873f69-1e16-4343-a63a-916fb17cead1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@144823e1 2021-04-14T12:24:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06873f69-1e16-4343-a63a-916fb17cead1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06873f69-1e16-4343-a63a-916fb17cead1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed38deac-5081-427e-93e8-64fb82114ddf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed38deac-5081-427e-93e8-64fb82114ddf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f85c867 2021-04-14T12:24:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed38deac-5081-427e-93e8-64fb82114ddf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed38deac-5081-427e-93e8-64fb82114ddf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e8244ad-cd4e-4bf3-aa8e-2ec7b58068f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e8244ad-cd4e-4bf3-aa8e-2ec7b58068f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fdceb7e 2021-04-14T12:24:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e8244ad-cd4e-4bf3-aa8e-2ec7b58068f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e8244ad-cd4e-4bf3-aa8e-2ec7b58068f8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:35.908Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5834f1b0-89b9-4ef3-bcb7-f1fd410f4a66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:35.908Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5834f1b0-89b9-4ef3-bcb7-f1fd410f4a66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72a48e4b 2021-04-14T12:24:35.908Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5834f1b0-89b9-4ef3-bcb7-f1fd410f4a66 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:35.908Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5834f1b0-89b9-4ef3-bcb7-f1fd410f4a66 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:38.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f66f646-e90a-4732-9279-cbd9c0db9c58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:38.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f66f646-e90a-4732-9279-cbd9c0db9c58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27a6fcd5 2021-04-14T12:24:38.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f66f646-e90a-4732-9279-cbd9c0db9c58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:38.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f66f646-e90a-4732-9279-cbd9c0db9c58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=039873c1-e855-4150-8f9d-16911fc84af6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=039873c1-e855-4150-8f9d-16911fc84af6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c1ceb6 2021-04-14T12:24:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=039873c1-e855-4150-8f9d-16911fc84af6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=039873c1-e855-4150-8f9d-16911fc84af6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:44.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d481414f-025c-4d3d-b7e5-6a2eae7a1030 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:44.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d481414f-025c-4d3d-b7e5-6a2eae7a1030 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ece420b 2021-04-14T12:24:44.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d481414f-025c-4d3d-b7e5-6a2eae7a1030 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:44.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d481414f-025c-4d3d-b7e5-6a2eae7a1030 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:47.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fae113-68d9-4a18-9aed-88e22d9196fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:47.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fae113-68d9-4a18-9aed-88e22d9196fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@584e434f 2021-04-14T12:24:47.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fae113-68d9-4a18-9aed-88e22d9196fc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:47.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60fae113-68d9-4a18-9aed-88e22d9196fc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ede4f35b-5984-4a81-8ae1-ea698ad58577 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ede4f35b-5984-4a81-8ae1-ea698ad58577 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@481e5cc7 2021-04-14T12:24:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ede4f35b-5984-4a81-8ae1-ea698ad58577 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ede4f35b-5984-4a81-8ae1-ea698ad58577 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:53.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7667ac75-8d48-4eb4-80d1-da0c753ab671 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:53.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7667ac75-8d48-4eb4-80d1-da0c753ab671 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40229f0c 2021-04-14T12:24:53.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7667ac75-8d48-4eb4-80d1-da0c753ab671 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:53.753Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7667ac75-8d48-4eb4-80d1-da0c753ab671 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09c72d6-2f12-4fb3-a3d1-086db2787f7b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09c72d6-2f12-4fb3-a3d1-086db2787f7b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c804319 2021-04-14T12:24:56.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09c72d6-2f12-4fb3-a3d1-086db2787f7b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:56.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b09c72d6-2f12-4fb3-a3d1-086db2787f7b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:24:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc0001af-3a13-4ac2-b256-905dcb80c5ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:24:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc0001af-3a13-4ac2-b256-905dcb80c5ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16fe3bfd 2021-04-14T12:24:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc0001af-3a13-4ac2-b256-905dcb80c5ca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:24:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc0001af-3a13-4ac2-b256-905dcb80c5ca PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb85943e-d651-4b78-91d4-b70e11f6c6bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb85943e-d651-4b78-91d4-b70e11f6c6bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cbcb581 2021-04-14T12:25:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb85943e-d651-4b78-91d4-b70e11f6c6bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb85943e-d651-4b78-91d4-b70e11f6c6bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e328834-2e28-4106-9f90-fe1bd133d50a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e328834-2e28-4106-9f90-fe1bd133d50a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78b295e5 2021-04-14T12:25:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e328834-2e28-4106-9f90-fe1bd133d50a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:06.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e328834-2e28-4106-9f90-fe1bd133d50a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add26090-0bcf-41a1-a33f-196ee71d19b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add26090-0bcf-41a1-a33f-196ee71d19b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46949961 2021-04-14T12:25:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add26090-0bcf-41a1-a33f-196ee71d19b4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add26090-0bcf-41a1-a33f-196ee71d19b4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555ed06d-e116-4d62-b55c-8fca3ab5e77e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555ed06d-e116-4d62-b55c-8fca3ab5e77e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21d2639d 2021-04-14T12:25:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555ed06d-e116-4d62-b55c-8fca3ab5e77e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=555ed06d-e116-4d62-b55c-8fca3ab5e77e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:13.576Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.578Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.578Z [TopicPollingThread-1] WARN c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Topic not found: /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:13.581Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.600Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.601Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.609Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.610Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.614Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.616Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.629Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=90f1f541-9804-4c9a-bac7-31fdfb85ec57 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.628869Z InvocationID=c942d0ad-02e9-4e05-94c0-1318ec3cd925 LogTimestamp=2021-04-14T12:25:13.628967Z Entering 2021-04-14T12:25:13.629Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=90f1f541-9804-4c9a-bac7-31fdfb85ec57 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.628869Z InvocationID=c942d0ad-02e9-4e05-94c0-1318ec3cd925 LogTimestamp=2021-04-14T12:25:13.628967Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.632Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.629Z InvocationID=17a6f230-2e7c-4fdc-80e6-abc3f77937a0 LogTimestamp=2021-04-14T12:25:13.632868Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.633Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.634Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.635Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.646Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.647Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.654Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.657Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.659Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.660Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.670Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fa6562a4-31bb-43c3-852f-01883e577c35 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.669908Z InvocationID=0284b586-4b82-490d-b145-51f40d6d58ac LogTimestamp=2021-04-14T12:25:13.669941Z Entering 2021-04-14T12:25:13.670Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fa6562a4-31bb-43c3-852f-01883e577c35 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.669908Z InvocationID=0284b586-4b82-490d-b145-51f40d6d58ac LogTimestamp=2021-04-14T12:25:13.669941Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.670Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.670Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.670Z InvocationID=00a52817-2c79-4539-ba46-d7da512695a3 LogTimestamp=2021-04-14T12:25:13.670920Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.671Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.672Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.706Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.707Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.713Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.714Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.721Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.721Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.729Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=93e073d0-fd3e-4a64-b7e6-3d83860d851d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.729013Z InvocationID=5f808c35-1212-4bcb-a590-7df6cc6dd49b LogTimestamp=2021-04-14T12:25:13.729065Z Entering 2021-04-14T12:25:13.729Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=93e073d0-fd3e-4a64-b7e6-3d83860d851d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.729013Z InvocationID=5f808c35-1212-4bcb-a590-7df6cc6dd49b LogTimestamp=2021-04-14T12:25:13.729065Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.730Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.729Z InvocationID=9ebf287d-b37e-4733-bd96-4a7e91cc16a8 LogTimestamp=2021-04-14T12:25:13.730026Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.730Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.740Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.741Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.746Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.746Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.749Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.750Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.760Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.761Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.762Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a055315c-e6e7-463d-bfb4-84824eacbbad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.761991Z InvocationID=ac24c2a1-ef48-4411-94f7-d43ac48beb4a LogTimestamp=2021-04-14T12:25:13.762031Z Entering 2021-04-14T12:25:13.762Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a055315c-e6e7-463d-bfb4-84824eacbbad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.761991Z InvocationID=ac24c2a1-ef48-4411-94f7-d43ac48beb4a LogTimestamp=2021-04-14T12:25:13.762031Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.763Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.762Z InvocationID=307b1ef1-2547-441c-9a5c-befb4d8de9cd LogTimestamp=2021-04-14T12:25:13.763361Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.764Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.770Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.771Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.773Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.774Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.778Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.779Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.789Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.791Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.798Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.799Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.805Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.806Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.806Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=451ed2e7-96d7-48d0-9a8f-21d1d38c025b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.806811Z InvocationID=15a8c52e-b4b2-414a-965c-793e6a9c6263 LogTimestamp=2021-04-14T12:25:13.806850Z Entering 2021-04-14T12:25:13.807Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=451ed2e7-96d7-48d0-9a8f-21d1d38c025b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.806811Z InvocationID=15a8c52e-b4b2-414a-965c-793e6a9c6263 LogTimestamp=2021-04-14T12:25:13.806850Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.808Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.807Z InvocationID=10a9a798-0106-4491-ab08-e35dcfdce6d7 LogTimestamp=2021-04-14T12:25:13.808065Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.808Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.809Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.810Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.814Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.815Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.819Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.820Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.823Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.824Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.827Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.833Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.842Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.843Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.846Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4abec678-0f91-4a65-91ee-8d1366324207 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.846074Z InvocationID=a55a459f-1fa6-4707-87a6-6a59914bfa33 LogTimestamp=2021-04-14T12:25:13.846134Z Entering 2021-04-14T12:25:13.846Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4abec678-0f91-4a65-91ee-8d1366324207 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.846074Z InvocationID=a55a459f-1fa6-4707-87a6-6a59914bfa33 LogTimestamp=2021-04-14T12:25:13.846134Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.847Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.846Z InvocationID=ad2e5531-e0bd-49e8-8cc9-f5f0b9645108 LogTimestamp=2021-04-14T12:25:13.847125Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.847Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.847Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.848Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.851Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.852Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.856Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.857Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.862Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.863Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.867Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.868Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.871Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.873Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.876Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.877Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cf0c3b84-b1d6-487b-84f5-4e797fc39aae InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.877034Z InvocationID=eacfeaa7-c1f6-448b-bc04-4f0e25ba12df LogTimestamp=2021-04-14T12:25:13.877070Z Entering 2021-04-14T12:25:13.877Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cf0c3b84-b1d6-487b-84f5-4e797fc39aae InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.877034Z InvocationID=eacfeaa7-c1f6-448b-bc04-4f0e25ba12df LogTimestamp=2021-04-14T12:25:13.877070Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.877Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.878Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.877Z InvocationID=094564d8-cecd-41bd-ba3e-7cfa280b95fd LogTimestamp=2021-04-14T12:25:13.878240Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.878Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.880Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.881Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.886Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.887Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.891Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.891Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.899Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.900Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.902Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.903Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.906Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.907Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.910Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.910Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.914Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f7276ef1-4236-4a00-9040-c14b23a08196 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.914090Z InvocationID=fb3c52dc-180e-44f7-9805-3dc9c1f208f1 LogTimestamp=2021-04-14T12:25:13.914209Z Entering 2021-04-14T12:25:13.914Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f7276ef1-4236-4a00-9040-c14b23a08196 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.914090Z InvocationID=fb3c52dc-180e-44f7-9805-3dc9c1f208f1 LogTimestamp=2021-04-14T12:25:13.914209Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.915Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.914Z InvocationID=22df7071-971e-41b4-89e4-32e90230f8dc LogTimestamp=2021-04-14T12:25:13.915456Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.915Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.919Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.920Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.926Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.927Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.949Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.950Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.956Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8f3a2828-d907-4f81-90f8-ab474992c6cd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.956394Z InvocationID=62c4aa5d-53b9-4bce-a5cb-de2eb28ab73a LogTimestamp=2021-04-14T12:25:13.956449Z Entering 2021-04-14T12:25:13.956Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8f3a2828-d907-4f81-90f8-ab474992c6cd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.956394Z InvocationID=62c4aa5d-53b9-4bce-a5cb-de2eb28ab73a LogTimestamp=2021-04-14T12:25:13.956449Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.957Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.956Z InvocationID=1449226c-f0ac-4a30-b9c7-ad49b98404db LogTimestamp=2021-04-14T12:25:13.957745Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.958Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.959Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.960Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.968Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.969Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.980Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.981Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.991Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.991Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:13.995Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d71e1e29-0111-440c-afa3-42ca6cc959d3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.995396Z InvocationID=24bea786-63ef-4b12-89f9-00a1e86ee3f4 LogTimestamp=2021-04-14T12:25:13.995446Z Entering 2021-04-14T12:25:13.995Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d71e1e29-0111-440c-afa3-42ca6cc959d3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:13.995396Z InvocationID=24bea786-63ef-4b12-89f9-00a1e86ee3f4 LogTimestamp=2021-04-14T12:25:13.995446Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:13.996Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:13.995Z InvocationID=79e382c1-e345-4d98-b1a8-58739d5ca19a LogTimestamp=2021-04-14T12:25:13.996826Z ResponseDesc=OK Exiting. 2021-04-14T12:25:13.997Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:13.997Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:13.997Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.001Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.001Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.006Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.007Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.014Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.015Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.026Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.027Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.033Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d9174847-d2a6-4891-90ad-2cc5fcca9bec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:14.033702Z InvocationID=77ca85a8-80c0-4639-9bdf-e147bd20c530 LogTimestamp=2021-04-14T12:25:14.033733Z Entering 2021-04-14T12:25:14.033Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d9174847-d2a6-4891-90ad-2cc5fcca9bec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:14.033702Z InvocationID=77ca85a8-80c0-4639-9bdf-e147bd20c530 LogTimestamp=2021-04-14T12:25:14.033733Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:14.035Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:14.034Z InvocationID=65435e26-9d50-4be5-888c-a6528bf77f02 LogTimestamp=2021-04-14T12:25:14.034998Z ResponseDesc=OK Exiting. 2021-04-14T12:25:14.035Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:14.035Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.037Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.047Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.048Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.057Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.058Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.062Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=86a11b04-3c07-4cc0-990e-819dbeb0fed0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:14.062079Z InvocationID=3b587196-8389-4421-b3d1-ec8f90d7d337 LogTimestamp=2021-04-14T12:25:14.062138Z Entering 2021-04-14T12:25:14.062Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=86a11b04-3c07-4cc0-990e-819dbeb0fed0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:14.062079Z InvocationID=3b587196-8389-4421-b3d1-ec8f90d7d337 LogTimestamp=2021-04-14T12:25:14.062138Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:14.063Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:14.062Z InvocationID=edad2ac2-576b-4b2d-a560-179c9e005376 LogTimestamp=2021-04-14T12:25:14.063584Z ResponseDesc=OK Exiting. 2021-04-14T12:25:14.064Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:14.069Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.070Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.073Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.074Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.077Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.077Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.080Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.081Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.085Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.085Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.088Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.089Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:14.093Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient \t--> HTTP/1.1 404 Not Found 2021-04-14T12:25:14.114Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d07079ff-afb3-4bbf-9d63-2ffcbc62969c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:14.114617Z InvocationID=8cf3e3c2-30ed-49d2-870c-76af5cb53457 LogTimestamp=2021-04-14T12:25:14.114662Z Entering 2021-04-14T12:25:14.114Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d07079ff-afb3-4bbf-9d63-2ffcbc62969c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:14.114617Z InvocationID=8cf3e3c2-30ed-49d2-870c-76af5cb53457 LogTimestamp=2021-04-14T12:25:14.114662Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:14.116Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:14.115Z InvocationID=879f1ad1-3f0e-4bdb-bc7a-b7ec68b2e8ff LogTimestamp=2021-04-14T12:25:14.116391Z ResponseDesc=OK Exiting. 2021-04-14T12:25:14.117Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5b1c51-0f1b-4b17-9f6c-58ee1d01da53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5b1c51-0f1b-4b17-9f6c-58ee1d01da53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@680bca9b 2021-04-14T12:25:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5b1c51-0f1b-4b17-9f6c-58ee1d01da53 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:14.792Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5b1c51-0f1b-4b17-9f6c-58ee1d01da53 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:18.101Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242f6e41-867d-45a5-b866-0a08373229b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242f6e41-867d-45a5-b866-0a08373229b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47a77c2 2021-04-14T12:25:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242f6e41-867d-45a5-b866-0a08373229b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242f6e41-867d-45a5-b866-0a08373229b1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f62aaa73-eed9-4eb1-9d4f-900d2460eecb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f62aaa73-eed9-4eb1-9d4f-900d2460eecb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66c7a9bd 2021-04-14T12:25:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f62aaa73-eed9-4eb1-9d4f-900d2460eecb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f62aaa73-eed9-4eb1-9d4f-900d2460eecb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9f9f4c-bc11-4109-b8a4-beb927c750e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9f9f4c-bc11-4109-b8a4-beb927c750e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54bbe073 2021-04-14T12:25:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9f9f4c-bc11-4109-b8a4-beb927c750e2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf9f9f4c-bc11-4109-b8a4-beb927c750e2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02d04268-fced-4482-a065-a1f042191e98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02d04268-fced-4482-a065-a1f042191e98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6252b76d 2021-04-14T12:25:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02d04268-fced-4482-a065-a1f042191e98 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02d04268-fced-4482-a065-a1f042191e98 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:28.578Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.580Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.580Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.582Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.583Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.584Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:28.584Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.584Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:25:28.584Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.584Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.585Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.585Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.585Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:28.585Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.585Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:25:28.586Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.586Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.587Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.588Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.588Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:28.588Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.588Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:25:28.588Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.589Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.590Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.590Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.590Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:28.591Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.591Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:25:28.591Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.591Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.592Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.593Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.593Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:28.593Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.593Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:25:28.593Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.593Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.595Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.595Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.595Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:28.595Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:25:28.595Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:25:28.596Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:25:28.596Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:25:28.597Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:28.597Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:25:28.597Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:25:29.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=300dd74f-79fe-4b08-a944-1a9b8a197142 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:29.811Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=300dd74f-79fe-4b08-a944-1a9b8a197142 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35c11882 2021-04-14T12:25:29.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=300dd74f-79fe-4b08-a944-1a9b8a197142 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:29.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=300dd74f-79fe-4b08-a944-1a9b8a197142 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d95211c2-cb56-470f-a36b-74edc7eb6f96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d95211c2-cb56-470f-a36b-74edc7eb6f96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e10d5c6 2021-04-14T12:25:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d95211c2-cb56-470f-a36b-74edc7eb6f96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d95211c2-cb56-470f-a36b-74edc7eb6f96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b41f469-abdc-44ce-9349-cc78ac585a36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b41f469-abdc-44ce-9349-cc78ac585a36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65a3180f 2021-04-14T12:25:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b41f469-abdc-44ce-9349-cc78ac585a36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:35.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b41f469-abdc-44ce-9349-cc78ac585a36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:36.248Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e1deb64b-b19a-4f41-985a-7f93a33024ab InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:36.248414Z InvocationID=bf7aa0b8-f931-432e-8340-b607565e1612 LogTimestamp=2021-04-14T12:25:36.248465Z Entering 2021-04-14T12:25:36.248Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e1deb64b-b19a-4f41-985a-7f93a33024ab InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:36.248414Z InvocationID=bf7aa0b8-f931-432e-8340-b607565e1612 LogTimestamp=2021-04-14T12:25:36.248465Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:36.249Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:36.248Z InvocationID=94849024-0a41-4a69-bd34-07ded0c45472 LogTimestamp=2021-04-14T12:25:36.249633Z ResponseDesc=OK Exiting. 2021-04-14T12:25:36.249Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:36.774Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ce839119-ad36-4bca-8bb8-aedb2ec6f7a8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:36.774768Z InvocationID=f3bc811a-8ace-47d3-9017-45a3e722971e LogTimestamp=2021-04-14T12:25:36.774798Z Entering 2021-04-14T12:25:36.775Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ce839119-ad36-4bca-8bb8-aedb2ec6f7a8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:36.774768Z InvocationID=f3bc811a-8ace-47d3-9017-45a3e722971e LogTimestamp=2021-04-14T12:25:36.774798Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:36.775Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:36.775Z InvocationID=37a5aeeb-8248-41f0-bb79-ac392a6b2827 LogTimestamp=2021-04-14T12:25:36.775827Z ResponseDesc=OK Exiting. 2021-04-14T12:25:36.776Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:39.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10053bdd-bae0-4339-a071-e67f35f06b92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:39.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10053bdd-bae0-4339-a071-e67f35f06b92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12bd2209 2021-04-14T12:25:39.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10053bdd-bae0-4339-a071-e67f35f06b92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:39.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10053bdd-bae0-4339-a071-e67f35f06b92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bca821cd-7c7c-476a-8d0c-a43282a08432 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bca821cd-7c7c-476a-8d0c-a43282a08432 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f853dd4 2021-04-14T12:25:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bca821cd-7c7c-476a-8d0c-a43282a08432 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bca821cd-7c7c-476a-8d0c-a43282a08432 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1504832d-89b4-4e15-a149-a7a6e35d5f48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1504832d-89b4-4e15-a149-a7a6e35d5f48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47d37307 2021-04-14T12:25:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1504832d-89b4-4e15-a149-a7a6e35d5f48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1504832d-89b4-4e15-a149-a7a6e35d5f48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:25:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:25:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6aa65a8-4bdb-42a8-9562-d6fa9f54a6f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6aa65a8-4bdb-42a8-9562-d6fa9f54a6f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3acd7892 2021-04-14T12:25:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6aa65a8-4bdb-42a8-9562-d6fa9f54a6f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6aa65a8-4bdb-42a8-9562-d6fa9f54a6f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:48.225Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b9dc4daf-ea72-450d-b970-23f3d38fa709 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:48.224936Z InvocationID=d9ba290f-78dc-4365-bfb6-908235b677b5 LogTimestamp=2021-04-14T12:25:48.225030Z Entering 2021-04-14T12:25:48.225Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b9dc4daf-ea72-450d-b970-23f3d38fa709 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:48.224936Z InvocationID=d9ba290f-78dc-4365-bfb6-908235b677b5 LogTimestamp=2021-04-14T12:25:48.225030Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:48.227Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:48.225Z InvocationID=56f40c09-a658-4467-948f-7775d63d965c LogTimestamp=2021-04-14T12:25:48.227915Z ResponseDesc=OK Exiting. 2021-04-14T12:25:48.228Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:51.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2000b2ba-1ba9-4a6e-83f5-8304367e89f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:51.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2000b2ba-1ba9-4a6e-83f5-8304367e89f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@411bb8a8 2021-04-14T12:25:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2000b2ba-1ba9-4a6e-83f5-8304367e89f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2000b2ba-1ba9-4a6e-83f5-8304367e89f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916eca1d-4ec6-4dde-aa0a-3034b011e12b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916eca1d-4ec6-4dde-aa0a-3034b011e12b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47f646c2 2021-04-14T12:25:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916eca1d-4ec6-4dde-aa0a-3034b011e12b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=916eca1d-4ec6-4dde-aa0a-3034b011e12b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:56.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b36c8dd-c341-463f-93ed-3dd93edcff53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:56.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b36c8dd-c341-463f-93ed-3dd93edcff53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b615e70 2021-04-14T12:25:56.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b36c8dd-c341-463f-93ed-3dd93edcff53 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:56.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b36c8dd-c341-463f-93ed-3dd93edcff53 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:25:57.589Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=894ea1bd-96e2-4f3c-bf10-65f0f499c698 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:57.589268Z InvocationID=1b96e8ec-8d90-4b1d-a7b2-a1b2d282bc99 LogTimestamp=2021-04-14T12:25:57.589323Z Entering 2021-04-14T12:25:57.589Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=894ea1bd-96e2-4f3c-bf10-65f0f499c698 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:25:57.589268Z InvocationID=1b96e8ec-8d90-4b1d-a7b2-a1b2d282bc99 LogTimestamp=2021-04-14T12:25:57.589323Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:25:57.591Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:25:57.589Z InvocationID=e8df4e18-72ef-4f6a-bc46-412b44e23420 LogTimestamp=2021-04-14T12:25:57.591422Z ResponseDesc=OK Exiting. 2021-04-14T12:25:57.591Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:25:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebadeac-05e5-4351-a7d7-979e2bb32e58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:25:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebadeac-05e5-4351-a7d7-979e2bb32e58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a39bc66 2021-04-14T12:25:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebadeac-05e5-4351-a7d7-979e2bb32e58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:25:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebadeac-05e5-4351-a7d7-979e2bb32e58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:01.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:02.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f8fe7d-8f29-4c73-95ec-ecdd434d7b55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:02.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f8fe7d-8f29-4c73-95ec-ecdd434d7b55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@567b9371 2021-04-14T12:26:02.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f8fe7d-8f29-4c73-95ec-ecdd434d7b55 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:02.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0f8fe7d-8f29-4c73-95ec-ecdd434d7b55 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:26:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:26:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:26:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:26:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:26:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:26:06.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5175742d-f129-4bc0-bf13-a2b28a5c68f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:06.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5175742d-f129-4bc0-bf13-a2b28a5c68f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23ce1f2a 2021-04-14T12:26:06.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5175742d-f129-4bc0-bf13-a2b28a5c68f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:06.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5175742d-f129-4bc0-bf13-a2b28a5c68f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:06.240Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6d2184d3-5757-420e-aa07-5d51286985dd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:06.240578Z InvocationID=551dff60-ffe6-469e-934a-468248769a00 LogTimestamp=2021-04-14T12:26:06.240629Z Entering 2021-04-14T12:26:06.240Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6d2184d3-5757-420e-aa07-5d51286985dd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:06.240578Z InvocationID=551dff60-ffe6-469e-934a-468248769a00 LogTimestamp=2021-04-14T12:26:06.240629Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:26:06.242Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:26:06.241Z InvocationID=6f2ef303-1540-476d-89ea-22e509ee152a LogTimestamp=2021-04-14T12:26:06.242150Z ResponseDesc=OK Exiting. 2021-04-14T12:26:06.242Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:26:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4278f3a8-e3e1-4d29-8534-29720a775298 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4278f3a8-e3e1-4d29-8534-29720a775298 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@324d47fd 2021-04-14T12:26:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4278f3a8-e3e1-4d29-8534-29720a775298 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4278f3a8-e3e1-4d29-8534-29720a775298 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:12.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87c1d3e5-5c1e-4440-aa47-c66729e588e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:12.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87c1d3e5-5c1e-4440-aa47-c66729e588e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3510075e 2021-04-14T12:26:12.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87c1d3e5-5c1e-4440-aa47-c66729e588e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:12.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87c1d3e5-5c1e-4440-aa47-c66729e588e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244e7fb0-bb49-4ed2-b32a-0bc9befe11e0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244e7fb0-bb49-4ed2-b32a-0bc9befe11e0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ffafa96 2021-04-14T12:26:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244e7fb0-bb49-4ed2-b32a-0bc9befe11e0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:14.682Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244e7fb0-bb49-4ed2-b32a-0bc9befe11e0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:17.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d12ca8-561e-42be-9362-8a3f2e86d42b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:17.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d12ca8-561e-42be-9362-8a3f2e86d42b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c1e850c 2021-04-14T12:26:17.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d12ca8-561e-42be-9362-8a3f2e86d42b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:17.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d12ca8-561e-42be-9362-8a3f2e86d42b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:20.588Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e3a19f0-cc0e-46ad-9972-77c53e49b88a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:20.588Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e3a19f0-cc0e-46ad-9972-77c53e49b88a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34b445dd 2021-04-14T12:26:20.588Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e3a19f0-cc0e-46ad-9972-77c53e49b88a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:20.588Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e3a19f0-cc0e-46ad-9972-77c53e49b88a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d435e3-2629-44ef-8452-af4a9f9c91b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d435e3-2629-44ef-8452-af4a9f9c91b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12b9ee2 2021-04-14T12:26:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d435e3-2629-44ef-8452-af4a9f9c91b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79d435e3-2629-44ef-8452-af4a9f9c91b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:24.126Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bfb8a8f6-a7c4-4bf4-936e-92da3de61948 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:24.125730Z InvocationID=fb859c24-9ab1-4b58-a413-14e1de6a506c LogTimestamp=2021-04-14T12:26:24.125859Z Entering 2021-04-14T12:26:24.126Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bfb8a8f6-a7c4-4bf4-936e-92da3de61948 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:24.125730Z InvocationID=fb859c24-9ab1-4b58-a413-14e1de6a506c LogTimestamp=2021-04-14T12:26:24.125859Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:26:24.128Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:26:24.126Z InvocationID=31f4f732-1390-4d43-8517-fd4030ca8691 LogTimestamp=2021-04-14T12:26:24.128632Z ResponseDesc=OK Exiting. 2021-04-14T12:26:24.129Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:26:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebd571e4-89a3-4102-9efb-c74e0f84e076 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebd571e4-89a3-4102-9efb-c74e0f84e076 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69edea1b 2021-04-14T12:26:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebd571e4-89a3-4102-9efb-c74e0f84e076 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:27.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebd571e4-89a3-4102-9efb-c74e0f84e076 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:29.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfb063c6-ce86-4615-b925-b3e1bff527bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:29.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfb063c6-ce86-4615-b925-b3e1bff527bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71c334cf 2021-04-14T12:26:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfb063c6-ce86-4615-b925-b3e1bff527bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfb063c6-ce86-4615-b925-b3e1bff527bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:33.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6dc9c0d-149b-4d4f-83d6-53dc07347bdb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:33.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6dc9c0d-149b-4d4f-83d6-53dc07347bdb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67cf0d87 2021-04-14T12:26:33.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6dc9c0d-149b-4d4f-83d6-53dc07347bdb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:33.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6dc9c0d-149b-4d4f-83d6-53dc07347bdb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:35.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ed0c9e-e579-4f71-9b6f-e27801d32973 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:35.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ed0c9e-e579-4f71-9b6f-e27801d32973 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ace4312 2021-04-14T12:26:35.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ed0c9e-e579-4f71-9b6f-e27801d32973 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:35.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43ed0c9e-e579-4f71-9b6f-e27801d32973 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:36.239Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c1685732-d0f1-42b6-8cd4-7230d649aec8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:36.239108Z InvocationID=0677839a-f893-4d55-a4d5-3321f5c6bf49 LogTimestamp=2021-04-14T12:26:36.239152Z Entering 2021-04-14T12:26:36.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c1685732-d0f1-42b6-8cd4-7230d649aec8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:36.239108Z InvocationID=0677839a-f893-4d55-a4d5-3321f5c6bf49 LogTimestamp=2021-04-14T12:26:36.239152Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:26:36.240Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:26:36.239Z InvocationID=676bdc08-6854-4df6-ab22-55d9a1be1dae LogTimestamp=2021-04-14T12:26:36.240585Z ResponseDesc=OK Exiting. 2021-04-14T12:26:36.240Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:26:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7406d1b-2552-48c2-a323-94f6798093fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7406d1b-2552-48c2-a323-94f6798093fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c75cb62 2021-04-14T12:26:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7406d1b-2552-48c2-a323-94f6798093fc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7406d1b-2552-48c2-a323-94f6798093fc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1882b75-28d0-4d55-ac5e-e088b82fdd84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1882b75-28d0-4d55-ac5e-e088b82fdd84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5478e56f 2021-04-14T12:26:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1882b75-28d0-4d55-ac5e-e088b82fdd84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1882b75-28d0-4d55-ac5e-e088b82fdd84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:41.814Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=027ddbce-c54b-4bfd-9842-5b58f15ece1f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:41.813958Z InvocationID=bbdecead-caa1-4a94-a3b1-7f34bf9815d3 LogTimestamp=2021-04-14T12:26:41.813994Z Entering 2021-04-14T12:26:41.814Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=027ddbce-c54b-4bfd-9842-5b58f15ece1f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:26:41.813958Z InvocationID=bbdecead-caa1-4a94-a3b1-7f34bf9815d3 LogTimestamp=2021-04-14T12:26:41.813994Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:26:41.815Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:26:41.814Z InvocationID=48c1b0d8-50f2-4c55-8572-45013f51030e LogTimestamp=2021-04-14T12:26:41.815765Z ResponseDesc=OK Exiting. 2021-04-14T12:26:41.816Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:26:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=637f14f2-1c7d-4163-87a0-ac2920ced5c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=637f14f2-1c7d-4163-87a0-ac2920ced5c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b447952 2021-04-14T12:26:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=637f14f2-1c7d-4163-87a0-ac2920ced5c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=637f14f2-1c7d-4163-87a0-ac2920ced5c5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:26:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:26:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b170096f-e2d6-4395-bb06-60d5b1aa9e41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b170096f-e2d6-4395-bb06-60d5b1aa9e41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3da65fb 2021-04-14T12:26:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b170096f-e2d6-4395-bb06-60d5b1aa9e41 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b170096f-e2d6-4395-bb06-60d5b1aa9e41 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f7afc2-7659-42bc-80b2-aac626ccedb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f7afc2-7659-42bc-80b2-aac626ccedb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11668039 2021-04-14T12:26:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f7afc2-7659-42bc-80b2-aac626ccedb1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:51.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e5f7afc2-7659-42bc-80b2-aac626ccedb1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:53.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=251f9fd3-9823-4ee0-a6d6-5a7822a3f81c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:53.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=251f9fd3-9823-4ee0-a6d6-5a7822a3f81c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a64ce7 2021-04-14T12:26:53.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=251f9fd3-9823-4ee0-a6d6-5a7822a3f81c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:53.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=251f9fd3-9823-4ee0-a6d6-5a7822a3f81c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:56.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c9c72a-0e0f-4e31-9907-449400af35f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:56.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c9c72a-0e0f-4e31-9907-449400af35f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ac03b08 2021-04-14T12:26:56.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c9c72a-0e0f-4e31-9907-449400af35f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:56.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c9c72a-0e0f-4e31-9907-449400af35f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aadbe2fb-3c09-4291-80e5-8af47488d5ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aadbe2fb-3c09-4291-80e5-8af47488d5ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a657e16 2021-04-14T12:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aadbe2fb-3c09-4291-80e5-8af47488d5ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aadbe2fb-3c09-4291-80e5-8af47488d5ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cc39309-44b0-4aff-aa82-567ffc75b573 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cc39309-44b0-4aff-aa82-567ffc75b573 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f27562b 2021-04-14T12:27:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cc39309-44b0-4aff-aa82-567ffc75b573 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:02.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8cc39309-44b0-4aff-aa82-567ffc75b573 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:27:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:27:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:27:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:27:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:27:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:27:06.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f8e10e5-c71d-4668-b769-42a5a31bd73e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:06.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f8e10e5-c71d-4668-b769-42a5a31bd73e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55a1d599 2021-04-14T12:27:06.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f8e10e5-c71d-4668-b769-42a5a31bd73e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:06.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f8e10e5-c71d-4668-b769-42a5a31bd73e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:06.230Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=591f667f-82a7-4fe2-a040-13df8bddbee6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:27:06.229869Z InvocationID=6b3dc3ed-22ea-4815-9209-b57a153a51ef LogTimestamp=2021-04-14T12:27:06.229916Z Entering 2021-04-14T12:27:06.230Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=591f667f-82a7-4fe2-a040-13df8bddbee6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:27:06.229869Z InvocationID=6b3dc3ed-22ea-4815-9209-b57a153a51ef LogTimestamp=2021-04-14T12:27:06.229916Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:27:06.231Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:27:06.230Z InvocationID=a0b375c5-382d-4909-892b-7b2ac0b7d1c7 LogTimestamp=2021-04-14T12:27:06.231912Z ResponseDesc=OK Exiting. 2021-04-14T12:27:06.232Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:27:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94aeb27-1c0a-4067-acaf-185872a31299 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94aeb27-1c0a-4067-acaf-185872a31299 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70125708 2021-04-14T12:27:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94aeb27-1c0a-4067-acaf-185872a31299 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:09.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c94aeb27-1c0a-4067-acaf-185872a31299 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=967ebd33-01b8-4bfa-bdaf-81dece5d99ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=967ebd33-01b8-4bfa-bdaf-81dece5d99ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@685e1d56 2021-04-14T12:27:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=967ebd33-01b8-4bfa-bdaf-81dece5d99ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=967ebd33-01b8-4bfa-bdaf-81dece5d99ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bef89f5-990c-4b9c-9318-35343bd45ae3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bef89f5-990c-4b9c-9318-35343bd45ae3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@252d26 2021-04-14T12:27:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bef89f5-990c-4b9c-9318-35343bd45ae3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bef89f5-990c-4b9c-9318-35343bd45ae3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:16.205Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:16.216Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:16.217Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:18.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99352d1-c69c-4c10-a8d5-bf5c3fc13d4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:18.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99352d1-c69c-4c10-a8d5-bf5c3fc13d4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5bf33da6 2021-04-14T12:27:18.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99352d1-c69c-4c10-a8d5-bf5c3fc13d4a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:18.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b99352d1-c69c-4c10-a8d5-bf5c3fc13d4a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:20.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6d7c70-4714-418b-8874-bb680ad4d011 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:20.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6d7c70-4714-418b-8874-bb680ad4d011 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@393b9bc7 2021-04-14T12:27:20.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6d7c70-4714-418b-8874-bb680ad4d011 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:20.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6d7c70-4714-418b-8874-bb680ad4d011 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:23.910Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5313464-5049-4848-ab85-d987622fb6b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:23.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5313464-5049-4848-ab85-d987622fb6b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2197951b 2021-04-14T12:27:23.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5313464-5049-4848-ab85-d987622fb6b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:23.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5313464-5049-4848-ab85-d987622fb6b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=143185da-cf7c-4d8c-b38d-b559aeff2969 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=143185da-cf7c-4d8c-b38d-b559aeff2969 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8f2d012 2021-04-14T12:27:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=143185da-cf7c-4d8c-b38d-b559aeff2969 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:27.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=143185da-cf7c-4d8c-b38d-b559aeff2969 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f0912a-ec11-4b6a-ba0e-8373f34f8b8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f0912a-ec11-4b6a-ba0e-8373f34f8b8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4aaed2a7 2021-04-14T12:27:30.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f0912a-ec11-4b6a-ba0e-8373f34f8b8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:30.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41f0912a-ec11-4b6a-ba0e-8373f34f8b8f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59870f85-435d-4b2f-83b0-1d7f9298596d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59870f85-435d-4b2f-83b0-1d7f9298596d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f2e8d96 2021-04-14T12:27:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59870f85-435d-4b2f-83b0-1d7f9298596d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59870f85-435d-4b2f-83b0-1d7f9298596d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:36.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=373c103c-27c0-40e8-b0a0-cde34320823f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:36.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=373c103c-27c0-40e8-b0a0-cde34320823f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@320cea25 2021-04-14T12:27:36.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=373c103c-27c0-40e8-b0a0-cde34320823f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:36.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=373c103c-27c0-40e8-b0a0-cde34320823f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:36.251Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fcd1821b-5dbf-45e5-b171-410034a7640a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:27:36.251283Z InvocationID=f52f0d4f-3ade-4450-b0df-a6e92ed2adbb LogTimestamp=2021-04-14T12:27:36.251368Z Entering 2021-04-14T12:27:36.251Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fcd1821b-5dbf-45e5-b171-410034a7640a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:27:36.251283Z InvocationID=f52f0d4f-3ade-4450-b0df-a6e92ed2adbb LogTimestamp=2021-04-14T12:27:36.251368Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:27:36.253Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:27:36.251Z InvocationID=3204f22e-2d7a-4b97-a64d-fe4181b26a26 LogTimestamp=2021-04-14T12:27:36.253269Z ResponseDesc=OK Exiting. 2021-04-14T12:27:36.253Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:27:39.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7620c5d-cc20-4707-948b-842214eef12c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:39.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7620c5d-cc20-4707-948b-842214eef12c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c60ce36 2021-04-14T12:27:39.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7620c5d-cc20-4707-948b-842214eef12c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:39.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d7620c5d-cc20-4707-948b-842214eef12c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:41.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25efbd5-6e38-4f8a-9784-d74ecdd473af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:41.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25efbd5-6e38-4f8a-9784-d74ecdd473af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10e70af7 2021-04-14T12:27:41.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25efbd5-6e38-4f8a-9784-d74ecdd473af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:41.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25efbd5-6e38-4f8a-9784-d74ecdd473af PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3278e5d0-9ed2-40b2-90e4-7f3b73d923e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3278e5d0-9ed2-40b2-90e4-7f3b73d923e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b7e7740 2021-04-14T12:27:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3278e5d0-9ed2-40b2-90e4-7f3b73d923e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3278e5d0-9ed2-40b2-90e4-7f3b73d923e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:27:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:27:48.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4898d917-1529-483f-a164-d4e82f947465 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:48.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4898d917-1529-483f-a164-d4e82f947465 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ef6f1c8 2021-04-14T12:27:48.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4898d917-1529-483f-a164-d4e82f947465 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:48.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4898d917-1529-483f-a164-d4e82f947465 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:48.237Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=97438397-2906-4068-8995-ef2b129f6e16 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:27:48.237427Z InvocationID=dd626fda-74b7-42ce-ac56-55a070fd0a71 LogTimestamp=2021-04-14T12:27:48.237467Z Entering 2021-04-14T12:27:48.237Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=97438397-2906-4068-8995-ef2b129f6e16 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:27:48.237427Z InvocationID=dd626fda-74b7-42ce-ac56-55a070fd0a71 LogTimestamp=2021-04-14T12:27:48.237467Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:27:48.238Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:27:48.237Z InvocationID=54280b38-1958-41ae-8f30-39225db3977c LogTimestamp=2021-04-14T12:27:48.238822Z ResponseDesc=OK Exiting. 2021-04-14T12:27:48.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:27:51.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cba56c3-c49a-413d-9d99-3995de102024 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:51.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cba56c3-c49a-413d-9d99-3995de102024 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@344d9d5e 2021-04-14T12:27:51.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cba56c3-c49a-413d-9d99-3995de102024 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:51.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2cba56c3-c49a-413d-9d99-3995de102024 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d212784-8578-49f0-bb6c-37f36e435989 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d212784-8578-49f0-bb6c-37f36e435989 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cd58992 2021-04-14T12:27:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d212784-8578-49f0-bb6c-37f36e435989 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d212784-8578-49f0-bb6c-37f36e435989 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:56.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=171e5841-9c31-4570-b165-91e371e9201a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:56.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=171e5841-9c31-4570-b165-91e371e9201a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2429293f 2021-04-14T12:27:56.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=171e5841-9c31-4570-b165-91e371e9201a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:56.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=171e5841-9c31-4570-b165-91e371e9201a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:27:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b293072-2686-4914-b2a0-62e06684ced2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:27:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b293072-2686-4914-b2a0-62e06684ced2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@df8f4c3 2021-04-14T12:27:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b293072-2686-4914-b2a0-62e06684ced2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:27:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b293072-2686-4914-b2a0-62e06684ced2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:02.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe054747-3b7e-49aa-8313-5b60ff43d4a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:02.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe054747-3b7e-49aa-8313-5b60ff43d4a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55873f4f 2021-04-14T12:28:02.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe054747-3b7e-49aa-8313-5b60ff43d4a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:02.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe054747-3b7e-49aa-8313-5b60ff43d4a7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:28:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:28:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:28:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:28:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:28:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:28:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c76965-3c77-4b1b-8c54-46322f89976f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c76965-3c77-4b1b-8c54-46322f89976f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@652ea574 2021-04-14T12:28:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c76965-3c77-4b1b-8c54-46322f89976f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43c76965-3c77-4b1b-8c54-46322f89976f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:06.238Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=35a78737-b472-4b86-a028-6f4dd6dd4798 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:28:06.237938Z InvocationID=f2b7798f-bf0c-4316-8b21-660862e32fa4 LogTimestamp=2021-04-14T12:28:06.237979Z Entering 2021-04-14T12:28:06.238Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=35a78737-b472-4b86-a028-6f4dd6dd4798 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:28:06.237938Z InvocationID=f2b7798f-bf0c-4316-8b21-660862e32fa4 LogTimestamp=2021-04-14T12:28:06.237979Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:28:06.239Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:28:06.238Z InvocationID=22d93df1-3ec2-4b64-a636-2f2c39bd7b64 LogTimestamp=2021-04-14T12:28:06.239373Z ResponseDesc=OK Exiting. 2021-04-14T12:28:06.239Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:28:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=516c83c6-0e79-4f7e-974d-0965d0786db0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=516c83c6-0e79-4f7e-974d-0965d0786db0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8a3083f 2021-04-14T12:28:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=516c83c6-0e79-4f7e-974d-0965d0786db0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=516c83c6-0e79-4f7e-974d-0965d0786db0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4901248-4098-43f8-b07f-076748662a03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4901248-4098-43f8-b07f-076748662a03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4237bb04 2021-04-14T12:28:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4901248-4098-43f8-b07f-076748662a03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:11.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4901248-4098-43f8-b07f-076748662a03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:14.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f6aae5c-2f56-473e-a6c7-c958260800e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:14.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f6aae5c-2f56-473e-a6c7-c958260800e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ea6994a 2021-04-14T12:28:14.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f6aae5c-2f56-473e-a6c7-c958260800e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:14.618Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f6aae5c-2f56-473e-a6c7-c958260800e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:16.201Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:16.214Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:16.215Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:16.216Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:18.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ffaf84-79bf-4086-b9b7-8feba64950fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:18.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ffaf84-79bf-4086-b9b7-8feba64950fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e339cef 2021-04-14T12:28:18.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ffaf84-79bf-4086-b9b7-8feba64950fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:18.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8ffaf84-79bf-4086-b9b7-8feba64950fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:20.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dec9da6-f072-487d-869f-1e5773e8c595 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:20.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dec9da6-f072-487d-869f-1e5773e8c595 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ec199e6 2021-04-14T12:28:20.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dec9da6-f072-487d-869f-1e5773e8c595 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:20.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5dec9da6-f072-487d-869f-1e5773e8c595 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:24.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46c32801-907c-41e0-bbf0-a9a7fec79e92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:24.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46c32801-907c-41e0-bbf0-a9a7fec79e92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5151f8a1 2021-04-14T12:28:24.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46c32801-907c-41e0-bbf0-a9a7fec79e92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:24.146Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46c32801-907c-41e0-bbf0-a9a7fec79e92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:27.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab048576-e2b2-4f5f-a4fa-2c9396c68524 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab048576-e2b2-4f5f-a4fa-2c9396c68524 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b274708 2021-04-14T12:28:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab048576-e2b2-4f5f-a4fa-2c9396c68524 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab048576-e2b2-4f5f-a4fa-2c9396c68524 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829dc9b5-bc9e-40e3-8457-06a8a514c4c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829dc9b5-bc9e-40e3-8457-06a8a514c4c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69d16e67 2021-04-14T12:28:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829dc9b5-bc9e-40e3-8457-06a8a514c4c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829dc9b5-bc9e-40e3-8457-06a8a514c4c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29b1c92-b3f5-4955-b1c3-3791d4551dd2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29b1c92-b3f5-4955-b1c3-3791d4551dd2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b7dd412 2021-04-14T12:28:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29b1c92-b3f5-4955-b1c3-3791d4551dd2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d29b1c92-b3f5-4955-b1c3-3791d4551dd2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77c9094-92af-4124-a0d1-07818764ad4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77c9094-92af-4124-a0d1-07818764ad4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15b7b92c 2021-04-14T12:28:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77c9094-92af-4124-a0d1-07818764ad4c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b77c9094-92af-4124-a0d1-07818764ad4c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:36.228Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7cd13010-1abb-437e-ac77-912e382ec7b0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:28:36.228439Z InvocationID=da69b4b1-2839-42ee-9b2f-1cb6a3617229 LogTimestamp=2021-04-14T12:28:36.228506Z Entering 2021-04-14T12:28:36.228Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7cd13010-1abb-437e-ac77-912e382ec7b0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:28:36.228439Z InvocationID=da69b4b1-2839-42ee-9b2f-1cb6a3617229 LogTimestamp=2021-04-14T12:28:36.228506Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:28:36.230Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:28:36.229Z InvocationID=b11aa260-135e-4095-b79e-8432e8984c75 LogTimestamp=2021-04-14T12:28:36.230912Z ResponseDesc=OK Exiting. 2021-04-14T12:28:36.231Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:28:38.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b22c2d4-5916-41b5-afd6-cb8b56a8b182 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:38.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b22c2d4-5916-41b5-afd6-cb8b56a8b182 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6459a395 2021-04-14T12:28:38.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b22c2d4-5916-41b5-afd6-cb8b56a8b182 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:38.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b22c2d4-5916-41b5-afd6-cb8b56a8b182 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=549b7a6d-a88e-4fc2-9347-731a97a1da68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=549b7a6d-a88e-4fc2-9347-731a97a1da68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6994b2f 2021-04-14T12:28:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=549b7a6d-a88e-4fc2-9347-731a97a1da68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=549b7a6d-a88e-4fc2-9347-731a97a1da68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f534ad6-5278-40c2-b3b4-e16c2961bf1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f534ad6-5278-40c2-b3b4-e16c2961bf1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23e1c2aa 2021-04-14T12:28:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f534ad6-5278-40c2-b3b4-e16c2961bf1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f534ad6-5278-40c2-b3b4-e16c2961bf1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:46.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:28:46.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:28:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c19ef9be-8584-4e3f-8279-9e8ab79bfdbf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c19ef9be-8584-4e3f-8279-9e8ab79bfdbf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b376123 2021-04-14T12:28:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c19ef9be-8584-4e3f-8279-9e8ab79bfdbf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c19ef9be-8584-4e3f-8279-9e8ab79bfdbf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:51.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=677b1a37-0bf0-4454-af1a-218502b23b4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:51.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=677b1a37-0bf0-4454-af1a-218502b23b4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@225b3edb 2021-04-14T12:28:51.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=677b1a37-0bf0-4454-af1a-218502b23b4f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:51.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=677b1a37-0bf0-4454-af1a-218502b23b4f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:53.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0765e8a-dc2e-4dbb-bd20-38b2e7f3d81c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:53.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0765e8a-dc2e-4dbb-bd20-38b2e7f3d81c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ed7d98c 2021-04-14T12:28:53.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0765e8a-dc2e-4dbb-bd20-38b2e7f3d81c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:53.765Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0765e8a-dc2e-4dbb-bd20-38b2e7f3d81c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1691b7d-6a73-4756-8658-0f8d7ba32a36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1691b7d-6a73-4756-8658-0f8d7ba32a36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@430ea26e 2021-04-14T12:28:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1691b7d-6a73-4756-8658-0f8d7ba32a36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1691b7d-6a73-4756-8658-0f8d7ba32a36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:28:59.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccdb2ac-9ce2-49ad-a0ab-e9c33ce10066 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:28:59.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccdb2ac-9ce2-49ad-a0ab-e9c33ce10066 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7300fd55 2021-04-14T12:28:59.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccdb2ac-9ce2-49ad-a0ab-e9c33ce10066 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:28:59.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ccdb2ac-9ce2-49ad-a0ab-e9c33ce10066 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:02.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e14d3b-9beb-498b-ae11-659982995038 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:02.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e14d3b-9beb-498b-ae11-659982995038 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8d6a808 2021-04-14T12:29:02.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e14d3b-9beb-498b-ae11-659982995038 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:02.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e14d3b-9beb-498b-ae11-659982995038 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:29:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:29:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:29:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:29:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:29:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:29:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1941611-012c-412a-84ef-825c3b8a9d03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1941611-012c-412a-84ef-825c3b8a9d03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@589d1b27 2021-04-14T12:29:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1941611-012c-412a-84ef-825c3b8a9d03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1941611-012c-412a-84ef-825c3b8a9d03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:06.243Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=06ca535a-67dc-473d-ae42-9efbd9f9b364 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:06.243532Z InvocationID=147b0992-2589-4f46-8134-b773996d2039 LogTimestamp=2021-04-14T12:29:06.243593Z Entering 2021-04-14T12:29:06.243Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=06ca535a-67dc-473d-ae42-9efbd9f9b364 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:06.243532Z InvocationID=147b0992-2589-4f46-8134-b773996d2039 LogTimestamp=2021-04-14T12:29:06.243593Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:29:06.245Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:29:06.244Z InvocationID=400ef9e5-846b-42c4-86f7-3bd6d4a44e96 LogTimestamp=2021-04-14T12:29:06.245306Z ResponseDesc=OK Exiting. 2021-04-14T12:29:06.245Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:29:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fab6f82-7513-4e74-8c40-3292a18bfa06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fab6f82-7513-4e74-8c40-3292a18bfa06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e36cf88 2021-04-14T12:29:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fab6f82-7513-4e74-8c40-3292a18bfa06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fab6f82-7513-4e74-8c40-3292a18bfa06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:10.592Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bd419012-b03a-4880-9ee2-3e93a0a9d3e3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:10.592130Z InvocationID=68926530-8037-457b-961a-43542b9c99e7 LogTimestamp=2021-04-14T12:29:10.592164Z Entering 2021-04-14T12:29:10.592Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bd419012-b03a-4880-9ee2-3e93a0a9d3e3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:10.592130Z InvocationID=68926530-8037-457b-961a-43542b9c99e7 LogTimestamp=2021-04-14T12:29:10.592164Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:29:10.593Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:29:10.592Z InvocationID=b32030c9-6b59-4d02-91c0-1609e3a921be LogTimestamp=2021-04-14T12:29:10.593324Z ResponseDesc=OK Exiting. 2021-04-14T12:29:10.593Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:29:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95618c25-6d5e-49a2-927f-949fae72066c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95618c25-6d5e-49a2-927f-949fae72066c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a287d4e 2021-04-14T12:29:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95618c25-6d5e-49a2-927f-949fae72066c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95618c25-6d5e-49a2-927f-949fae72066c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e947615d-57c0-44b6-9ebe-60dbe0773624 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e947615d-57c0-44b6-9ebe-60dbe0773624 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@278310eb 2021-04-14T12:29:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e947615d-57c0-44b6-9ebe-60dbe0773624 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e947615d-57c0-44b6-9ebe-60dbe0773624 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:16.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:17.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4587b04-ad08-4fcd-8452-0bd7bffa3cd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:17.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4587b04-ad08-4fcd-8452-0bd7bffa3cd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17f7631f 2021-04-14T12:29:17.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4587b04-ad08-4fcd-8452-0bd7bffa3cd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:17.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4587b04-ad08-4fcd-8452-0bd7bffa3cd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7079070-e466-44f1-9f26-9763d0cf0efb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7079070-e466-44f1-9f26-9763d0cf0efb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f65b4e6 2021-04-14T12:29:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7079070-e466-44f1-9f26-9763d0cf0efb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7079070-e466-44f1-9f26-9763d0cf0efb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860080c3-3ac8-496b-83c7-fb34ef7cd6a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:24.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860080c3-3ac8-496b-83c7-fb34ef7cd6a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@167e7249 2021-04-14T12:29:24.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860080c3-3ac8-496b-83c7-fb34ef7cd6a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:24.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860080c3-3ac8-496b-83c7-fb34ef7cd6a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:27.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9c53da5-c223-4190-abef-1751dfb3b49d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:27.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9c53da5-c223-4190-abef-1751dfb3b49d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29c52c25 2021-04-14T12:29:27.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9c53da5-c223-4190-abef-1751dfb3b49d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:27.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9c53da5-c223-4190-abef-1751dfb3b49d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:30.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9f788f-c4d7-46fd-86e6-334dc07bbaa8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:30.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9f788f-c4d7-46fd-86e6-334dc07bbaa8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5065d99 2021-04-14T12:29:30.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9f788f-c4d7-46fd-86e6-334dc07bbaa8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:30.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd9f788f-c4d7-46fd-86e6-334dc07bbaa8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbf7b18e-0add-4b7d-94e2-c2d5744d4336 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbf7b18e-0add-4b7d-94e2-c2d5744d4336 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67a61b5b 2021-04-14T12:29:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbf7b18e-0add-4b7d-94e2-c2d5744d4336 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:33.417Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbf7b18e-0add-4b7d-94e2-c2d5744d4336 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:35.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899cd7f5-97c3-4282-9ce8-16c52041e5cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:35.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899cd7f5-97c3-4282-9ce8-16c52041e5cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22fc1dc 2021-04-14T12:29:36.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899cd7f5-97c3-4282-9ce8-16c52041e5cb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:36.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=899cd7f5-97c3-4282-9ce8-16c52041e5cb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:36.235Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0cfc038b-8543-4735-8877-6f68675c5e56 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:36.234914Z InvocationID=c5846e22-c35f-4626-9337-6cc6982537f1 LogTimestamp=2021-04-14T12:29:36.235048Z Entering 2021-04-14T12:29:36.235Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0cfc038b-8543-4735-8877-6f68675c5e56 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:36.234914Z InvocationID=c5846e22-c35f-4626-9337-6cc6982537f1 LogTimestamp=2021-04-14T12:29:36.235048Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:29:36.237Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:29:36.236Z InvocationID=70edde48-2d63-47aa-b7b5-6ccc21197f4b LogTimestamp=2021-04-14T12:29:36.237869Z ResponseDesc=OK Exiting. 2021-04-14T12:29:36.238Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:29:38.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d9c844-d8b1-4be4-8e61-bcb9f1823bd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:38.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d9c844-d8b1-4be4-8e61-bcb9f1823bd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28b61b8 2021-04-14T12:29:38.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d9c844-d8b1-4be4-8e61-bcb9f1823bd9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:38.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61d9c844-d8b1-4be4-8e61-bcb9f1823bd9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bf4de9-1b19-4d4f-b1e7-70771711e7a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bf4de9-1b19-4d4f-b1e7-70771711e7a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35561ee5 2021-04-14T12:29:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bf4de9-1b19-4d4f-b1e7-70771711e7a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2bf4de9-1b19-4d4f-b1e7-70771711e7a3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4e81c1-b0bd-4302-8b99-994c9bb50a5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4e81c1-b0bd-4302-8b99-994c9bb50a5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@627da7d7 2021-04-14T12:29:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4e81c1-b0bd-4302-8b99-994c9bb50a5d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce4e81c1-b0bd-4302-8b99-994c9bb50a5d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:29:46.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:29:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52320bf4-aec6-4d3e-ae82-01aa46f5256b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52320bf4-aec6-4d3e-ae82-01aa46f5256b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e20ab65 2021-04-14T12:29:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52320bf4-aec6-4d3e-ae82-01aa46f5256b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52320bf4-aec6-4d3e-ae82-01aa46f5256b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:48.224Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=651277d6-0213-4514-a446-abebdb62e9d7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:48.223907Z InvocationID=085b53f9-733e-4088-82a5-63b6dc2d3339 LogTimestamp=2021-04-14T12:29:48.224009Z Entering 2021-04-14T12:29:48.224Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=651277d6-0213-4514-a446-abebdb62e9d7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:29:48.223907Z InvocationID=085b53f9-733e-4088-82a5-63b6dc2d3339 LogTimestamp=2021-04-14T12:29:48.224009Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:29:48.227Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:29:48.224Z InvocationID=477cdc04-aed4-4aa2-abda-ea4ca043ead9 LogTimestamp=2021-04-14T12:29:48.227840Z ResponseDesc=OK Exiting. 2021-04-14T12:29:48.228Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:29:51.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30ef1bf4-e864-4295-b3aa-931819a88e64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:51.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30ef1bf4-e864-4295-b3aa-931819a88e64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47ff8fb8 2021-04-14T12:29:51.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30ef1bf4-e864-4295-b3aa-931819a88e64 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:51.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30ef1bf4-e864-4295-b3aa-931819a88e64 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:53.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f5843-4812-406a-8055-334d220e725c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:53.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f5843-4812-406a-8055-334d220e725c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42db1094 2021-04-14T12:29:53.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f5843-4812-406a-8055-334d220e725c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:53.947Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=409f5843-4812-406a-8055-334d220e725c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd644fa4-bb93-448f-9f02-9b36d57e7cd8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd644fa4-bb93-448f-9f02-9b36d57e7cd8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d175407 2021-04-14T12:29:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd644fa4-bb93-448f-9f02-9b36d57e7cd8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:56.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd644fa4-bb93-448f-9f02-9b36d57e7cd8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:29:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae3eca76-5798-4692-9d5d-23bb912edf2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:29:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae3eca76-5798-4692-9d5d-23bb912edf2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5677a543 2021-04-14T12:29:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae3eca76-5798-4692-9d5d-23bb912edf2c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:29:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae3eca76-5798-4692-9d5d-23bb912edf2c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:02.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72314646-dfbc-40e0-89a7-3611d6a7f5f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72314646-dfbc-40e0-89a7-3611d6a7f5f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d4e627a 2021-04-14T12:30:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72314646-dfbc-40e0-89a7-3611d6a7f5f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72314646-dfbc-40e0-89a7-3611d6a7f5f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:30:04.352Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:30:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:30:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:30:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:30:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:30:06.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc20ab22-282f-42e7-98a2-0cb096a4ef59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:06.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc20ab22-282f-42e7-98a2-0cb096a4ef59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@770b90f7 2021-04-14T12:30:06.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc20ab22-282f-42e7-98a2-0cb096a4ef59 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:06.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc20ab22-282f-42e7-98a2-0cb096a4ef59 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:06.240Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=67e7f37b-e5fe-42fb-a470-fef8b2be25cf InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:30:06.240437Z InvocationID=82d73668-3fd0-4c77-a487-594d4e56e1c0 LogTimestamp=2021-04-14T12:30:06.240524Z Entering 2021-04-14T12:30:06.241Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=67e7f37b-e5fe-42fb-a470-fef8b2be25cf InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:30:06.240437Z InvocationID=82d73668-3fd0-4c77-a487-594d4e56e1c0 LogTimestamp=2021-04-14T12:30:06.240524Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:30:06.243Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:30:06.241Z InvocationID=76c8d92d-8cae-4014-a4de-33516e1cf8a1 LogTimestamp=2021-04-14T12:30:06.243213Z ResponseDesc=OK Exiting. 2021-04-14T12:30:06.243Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:30:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=254777ad-be95-4bee-8e4b-8b34d152b0ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=254777ad-be95-4bee-8e4b-8b34d152b0ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b557d 2021-04-14T12:30:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=254777ad-be95-4bee-8e4b-8b34d152b0ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=254777ad-be95-4bee-8e4b-8b34d152b0ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=487b76dc-43cd-429a-b0d7-5fe1d9d40494 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=487b76dc-43cd-429a-b0d7-5fe1d9d40494 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bfdb58a 2021-04-14T12:30:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=487b76dc-43cd-429a-b0d7-5fe1d9d40494 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=487b76dc-43cd-429a-b0d7-5fe1d9d40494 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:14.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eab1264-ded3-44fa-8f1f-470df5d4da00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:14.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eab1264-ded3-44fa-8f1f-470df5d4da00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@753e473d 2021-04-14T12:30:14.685Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eab1264-ded3-44fa-8f1f-470df5d4da00 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eab1264-ded3-44fa-8f1f-470df5d4da00 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:18.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d766b1c-7096-44f1-8ce6-2d0a6dd26881 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:18.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d766b1c-7096-44f1-8ce6-2d0a6dd26881 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e19ed45 2021-04-14T12:30:18.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d766b1c-7096-44f1-8ce6-2d0a6dd26881 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:18.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d766b1c-7096-44f1-8ce6-2d0a6dd26881 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6ed2b53-4334-4d18-9e4a-a18478d5660c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6ed2b53-4334-4d18-9e4a-a18478d5660c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a3ab46 2021-04-14T12:30:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6ed2b53-4334-4d18-9e4a-a18478d5660c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6ed2b53-4334-4d18-9e4a-a18478d5660c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:24.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f1aa8a7-bd41-42cf-b87f-376bc2f62d5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:24.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f1aa8a7-bd41-42cf-b87f-376bc2f62d5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f40fbd 2021-04-14T12:30:24.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f1aa8a7-bd41-42cf-b87f-376bc2f62d5e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:24.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f1aa8a7-bd41-42cf-b87f-376bc2f62d5e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:27.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71945b99-5b81-44f9-8236-f9faf6ae7559 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:27.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71945b99-5b81-44f9-8236-f9faf6ae7559 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@574b771 2021-04-14T12:30:27.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71945b99-5b81-44f9-8236-f9faf6ae7559 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:27.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71945b99-5b81-44f9-8236-f9faf6ae7559 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aabe8c1-7aa3-475d-a89d-91ddfd4b7031 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aabe8c1-7aa3-475d-a89d-91ddfd4b7031 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1416015f 2021-04-14T12:30:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aabe8c1-7aa3-475d-a89d-91ddfd4b7031 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aabe8c1-7aa3-475d-a89d-91ddfd4b7031 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a45a8f-dd0b-4a86-848c-d01593594d66 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a45a8f-dd0b-4a86-848c-d01593594d66 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d766100 2021-04-14T12:30:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a45a8f-dd0b-4a86-848c-d01593594d66 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30a45a8f-dd0b-4a86-848c-d01593594d66 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bw37oawbhz4m1hnwgd6kszqjx274 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01e66puctckl5f3b13lg2l8je0284 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01chu7kkdnl1sg1xy86pvlj9k6271 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0n82tvkl8248318cd2h8b8hunn270 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01n3hvokh3i0sy1tbl1hni607rm261 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018z7qkw04g1zm1xwgxvwq15pn4251 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0113byy8miie2k1ps4qwr03uvzr286 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07vxykwdvuwcmgq5fp2uva5h4277 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ongqgyf7suc3khwvmxk4ator252 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01wv2mh89fx4sk11ylgledvudze263 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node052w01slthie6113amtq899eav275 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0vnqccanm50k31rcjm8ro2ziw6265 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01uf628b0670d93pnxpxov5rrq258 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bl0gvgbamnbe1ujj5dgbjwk9p272 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09mzp5h8wohcub4lmrva96gsp255 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0hbrfiscd5sgt5h16fm5cibf1264 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01rrp9q56mm6zrk0ou0o0gs0c260 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node048r9xx082xfo16g5kwln8bh2h273 2021-04-14T12:30:34.614Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node030tg2vr3jxgy1rafvtpzqtfwy276 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node044eiwhowcxn2u7b8qoiuaa26280 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01pd8jymp9pzbudaq5lkahpac2267 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qljgfkzst3z816m3vkxvq58fu253 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010hln80lqrwo91rmi2rng1zn1c266 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d7icxy9ryfskvuqgeolcl6ga285 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0agqbd5cad6j1aj8t3zgrzr0o281 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013dajtobgsndv11w3goj16d9hw259 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04ijg1aceewgm12vjhv5456hz5254 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0134z323h73d8c7p16mn0741bb287 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0usua71ig6i651m8j5uk34iyjk279 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01d8smq8ksipbz17qjsxgl02v8x282 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01i7g8iztc7fjg1qnbg8l9ayww0278 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bwf1dbptv4kz1dcgr63w28rp6256 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qpg2b0iccznag3lyqvh24ig4269 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01fth0ha7d9b7n125dixqeql521257 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012ykduokrdytklosnzakepnj5262 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0si4klgji84y9okc9cpaifel283 2021-04-14T12:30:34.615Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xy20g556phq217zqb1m4h2bl9268 2021-04-14T12:30:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8166ecdf-1d70-45e0-b9be-1b90bb08736d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8166ecdf-1d70-45e0-b9be-1b90bb08736d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fdd1ef4 2021-04-14T12:30:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8166ecdf-1d70-45e0-b9be-1b90bb08736d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8166ecdf-1d70-45e0-b9be-1b90bb08736d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:36.229Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9f046e02-6a73-4d77-bf66-c03040319cb7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:30:36.229033Z InvocationID=336169aa-8d52-4884-bc27-06422cb4da3d LogTimestamp=2021-04-14T12:30:36.229091Z Entering 2021-04-14T12:30:36.229Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9f046e02-6a73-4d77-bf66-c03040319cb7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:30:36.229033Z InvocationID=336169aa-8d52-4884-bc27-06422cb4da3d LogTimestamp=2021-04-14T12:30:36.229091Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:30:36.230Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:30:36.229Z InvocationID=a9efcce9-6d0c-4697-91a5-ba314ade36ac LogTimestamp=2021-04-14T12:30:36.230690Z ResponseDesc=OK Exiting. 2021-04-14T12:30:36.230Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:30:38.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba1108c-b59e-447d-b21c-83c4a2cef242 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:38.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba1108c-b59e-447d-b21c-83c4a2cef242 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fb2fb41 2021-04-14T12:30:38.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba1108c-b59e-447d-b21c-83c4a2cef242 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:38.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba1108c-b59e-447d-b21c-83c4a2cef242 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8688589c-9474-4661-adbe-b3776ad683ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8688589c-9474-4661-adbe-b3776ad683ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b0a1f11 2021-04-14T12:30:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8688589c-9474-4661-adbe-b3776ad683ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8688589c-9474-4661-adbe-b3776ad683ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:44.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5132be90-118e-43e4-b0a8-2726e3def24e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:44.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5132be90-118e-43e4-b0a8-2726e3def24e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@154a1511 2021-04-14T12:30:44.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5132be90-118e-43e4-b0a8-2726e3def24e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:44.824Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5132be90-118e-43e4-b0a8-2726e3def24e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:30:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:30:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d519a0-8af6-4584-b8b1-e13a68bc99a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d519a0-8af6-4584-b8b1-e13a68bc99a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@522793f2 2021-04-14T12:30:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d519a0-8af6-4584-b8b1-e13a68bc99a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:47.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d519a0-8af6-4584-b8b1-e13a68bc99a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3344b448-0131-4740-9696-1e43df9e5fc6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3344b448-0131-4740-9696-1e43df9e5fc6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ad71204 2021-04-14T12:30:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3344b448-0131-4740-9696-1e43df9e5fc6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3344b448-0131-4740-9696-1e43df9e5fc6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:53.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2de62083-f815-4aba-83be-c571dd493190 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:53.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2de62083-f815-4aba-83be-c571dd493190 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31de7ed8 2021-04-14T12:30:53.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2de62083-f815-4aba-83be-c571dd493190 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:53.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2de62083-f815-4aba-83be-c571dd493190 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:57.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e804fa8-7cd8-4009-99d9-5277eda86d42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:57.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e804fa8-7cd8-4009-99d9-5277eda86d42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74f9176f 2021-04-14T12:30:57.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e804fa8-7cd8-4009-99d9-5277eda86d42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:57.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e804fa8-7cd8-4009-99d9-5277eda86d42 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:30:58.975Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d4b34633-072a-40fd-9e04-2e72902e6621 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:30:58.974839Z InvocationID=7ddbad9c-8789-4a87-a0ae-cdb6bb648f86 LogTimestamp=2021-04-14T12:30:58.974927Z Entering 2021-04-14T12:30:58.975Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d4b34633-072a-40fd-9e04-2e72902e6621 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:30:58.974839Z InvocationID=7ddbad9c-8789-4a87-a0ae-cdb6bb648f86 LogTimestamp=2021-04-14T12:30:58.974927Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:30:58.976Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:30:58.975Z InvocationID=110484a0-f9e5-402d-b0d3-b2904b47cb79 LogTimestamp=2021-04-14T12:30:58.976791Z ResponseDesc=OK Exiting. 2021-04-14T12:30:58.977Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:30:59.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c93922-431a-4fbc-a354-42e2d40b9b70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:30:59.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c93922-431a-4fbc-a354-42e2d40b9b70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1aafa201 2021-04-14T12:30:59.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c93922-431a-4fbc-a354-42e2d40b9b70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:30:59.575Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16c93922-431a-4fbc-a354-42e2d40b9b70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28542ce-6dae-4533-8c1b-f5e8b9701893 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28542ce-6dae-4533-8c1b-f5e8b9701893 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@681ac462 2021-04-14T12:31:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28542ce-6dae-4533-8c1b-f5e8b9701893 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28542ce-6dae-4533-8c1b-f5e8b9701893 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:31:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:31:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:31:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:31:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:31:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:31:06.264Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=92b948c1-e86b-4d84-9929-805372810e30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:31:06.263653Z InvocationID=70314bee-3908-46b5-936b-d3669602c06e LogTimestamp=2021-04-14T12:31:06.263725Z Entering 2021-04-14T12:31:06.264Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=92b948c1-e86b-4d84-9929-805372810e30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:31:06.263653Z InvocationID=70314bee-3908-46b5-936b-d3669602c06e LogTimestamp=2021-04-14T12:31:06.263725Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:31:06.266Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:31:06.264Z InvocationID=8ce145cf-9b13-4aec-acc0-2359c663f8b8 LogTimestamp=2021-04-14T12:31:06.266657Z ResponseDesc=OK Exiting. 2021-04-14T12:31:06.267Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:31:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fffa8f73-6f42-45a6-8419-c4c3235d17c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fffa8f73-6f42-45a6-8419-c4c3235d17c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a705f07 2021-04-14T12:31:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fffa8f73-6f42-45a6-8419-c4c3235d17c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fffa8f73-6f42-45a6-8419-c4c3235d17c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e00ac477-6625-44a4-8f17-7b05c2239f93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e00ac477-6625-44a4-8f17-7b05c2239f93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@168e7749 2021-04-14T12:31:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e00ac477-6625-44a4-8f17-7b05c2239f93 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e00ac477-6625-44a4-8f17-7b05c2239f93 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002205e1-5de8-4c59-9b63-852174e36feb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002205e1-5de8-4c59-9b63-852174e36feb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71d67033 2021-04-14T12:31:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002205e1-5de8-4c59-9b63-852174e36feb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=002205e1-5de8-4c59-9b63-852174e36feb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd201e-5314-44d8-bf70-197940f16a25 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd201e-5314-44d8-bf70-197940f16a25 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f5193bf 2021-04-14T12:31:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd201e-5314-44d8-bf70-197940f16a25 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78bd201e-5314-44d8-bf70-197940f16a25 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:18.201Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e247beb5-d6fc-446e-b6ee-3ce27a4c8d6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:18.201Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e247beb5-d6fc-446e-b6ee-3ce27a4c8d6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67716535 2021-04-14T12:31:18.201Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e247beb5-d6fc-446e-b6ee-3ce27a4c8d6b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:18.201Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e247beb5-d6fc-446e-b6ee-3ce27a4c8d6b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a3b9e42-a80a-43ee-bec2-76d4f83dcdc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a3b9e42-a80a-43ee-bec2-76d4f83dcdc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a062ad 2021-04-14T12:31:20.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a3b9e42-a80a-43ee-bec2-76d4f83dcdc8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:20.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a3b9e42-a80a-43ee-bec2-76d4f83dcdc8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93b5644-d6a4-4bb0-8120-9fa19c1a139d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93b5644-d6a4-4bb0-8120-9fa19c1a139d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4035cd22 2021-04-14T12:31:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93b5644-d6a4-4bb0-8120-9fa19c1a139d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e93b5644-d6a4-4bb0-8120-9fa19c1a139d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:27.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2336232-fe84-41b6-882f-79d5c0c71d82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:27.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2336232-fe84-41b6-882f-79d5c0c71d82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ba62f0 2021-04-14T12:31:27.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2336232-fe84-41b6-882f-79d5c0c71d82 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:27.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2336232-fe84-41b6-882f-79d5c0c71d82 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:29.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e327e1a-674c-424d-ac8f-36917d19bbfa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:29.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e327e1a-674c-424d-ac8f-36917d19bbfa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f0ef77f 2021-04-14T12:31:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e327e1a-674c-424d-ac8f-36917d19bbfa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e327e1a-674c-424d-ac8f-36917d19bbfa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:33.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ccd607-c925-4b67-8678-a3c1dbceb608 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:33.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ccd607-c925-4b67-8678-a3c1dbceb608 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e3a5539 2021-04-14T12:31:33.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ccd607-c925-4b67-8678-a3c1dbceb608 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:33.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7ccd607-c925-4b67-8678-a3c1dbceb608 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8892338-d32a-4a28-9449-04115931a6bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8892338-d32a-4a28-9449-04115931a6bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@88d901 2021-04-14T12:31:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8892338-d32a-4a28-9449-04115931a6bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:35.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f8892338-d32a-4a28-9449-04115931a6bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:36.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cd67e871-4eed-4c05-afce-355903eac26d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:31:36.234940Z InvocationID=21ca159e-4dfc-4057-8c75-603cdf03b2ce LogTimestamp=2021-04-14T12:31:36.235115Z Entering 2021-04-14T12:31:36.236Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cd67e871-4eed-4c05-afce-355903eac26d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:31:36.234940Z InvocationID=21ca159e-4dfc-4057-8c75-603cdf03b2ce LogTimestamp=2021-04-14T12:31:36.235115Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:31:36.239Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:31:36.237Z InvocationID=da31adc9-919e-4858-bd19-a8cb009bae14 LogTimestamp=2021-04-14T12:31:36.239586Z ResponseDesc=OK Exiting. 2021-04-14T12:31:36.239Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:31:39.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8fd19d7-b624-4ed8-a519-2d06077744a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:39.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8fd19d7-b624-4ed8-a519-2d06077744a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50f58602 2021-04-14T12:31:39.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8fd19d7-b624-4ed8-a519-2d06077744a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:39.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8fd19d7-b624-4ed8-a519-2d06077744a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f00bf863-9925-4ffd-8ddc-6dc344885aad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f00bf863-9925-4ffd-8ddc-6dc344885aad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48d8366c 2021-04-14T12:31:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f00bf863-9925-4ffd-8ddc-6dc344885aad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f00bf863-9925-4ffd-8ddc-6dc344885aad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b924a9b3-42ee-4dd3-b058-41911c770423 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b924a9b3-42ee-4dd3-b058-41911c770423 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74f721d3 2021-04-14T12:31:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b924a9b3-42ee-4dd3-b058-41911c770423 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b924a9b3-42ee-4dd3-b058-41911c770423 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:31:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:31:47.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e8d6f-f8ba-42dd-9d6a-47c919fe19ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:47.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e8d6f-f8ba-42dd-9d6a-47c919fe19ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3271be9d 2021-04-14T12:31:47.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e8d6f-f8ba-42dd-9d6a-47c919fe19ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:47.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e8d6f-f8ba-42dd-9d6a-47c919fe19ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:48.211Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fcfabead-1b7f-4ec2-a029-712f23c45e19 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:31:48.211295Z InvocationID=3f4bf55a-3fe0-4f3f-ab18-5b21a843e67d LogTimestamp=2021-04-14T12:31:48.211335Z Entering 2021-04-14T12:31:48.211Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fcfabead-1b7f-4ec2-a029-712f23c45e19 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:31:48.211295Z InvocationID=3f4bf55a-3fe0-4f3f-ab18-5b21a843e67d LogTimestamp=2021-04-14T12:31:48.211335Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:31:48.212Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:31:48.211Z InvocationID=dcc3fd3e-f1a6-486d-8465-8bdf56c68744 LogTimestamp=2021-04-14T12:31:48.212409Z ResponseDesc=OK Exiting. 2021-04-14T12:31:48.212Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:31:51.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85635630-a0d5-4445-a178-afb37fdbb4df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:51.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85635630-a0d5-4445-a178-afb37fdbb4df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e48fb47 2021-04-14T12:31:51.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85635630-a0d5-4445-a178-afb37fdbb4df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:51.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85635630-a0d5-4445-a178-afb37fdbb4df PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:54.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03cf6649-daa2-4a8a-bbe5-b57e8ce7dbd4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:54.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03cf6649-daa2-4a8a-bbe5-b57e8ce7dbd4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@472acfb4 2021-04-14T12:31:54.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03cf6649-daa2-4a8a-bbe5-b57e8ce7dbd4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:54.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03cf6649-daa2-4a8a-bbe5-b57e8ce7dbd4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:57.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4785b89-f53f-4d58-baf8-b64ab4709c02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:57.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4785b89-f53f-4d58-baf8-b64ab4709c02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a1e873b 2021-04-14T12:31:57.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4785b89-f53f-4d58-baf8-b64ab4709c02 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:57.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b4785b89-f53f-4d58-baf8-b64ab4709c02 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:31:59.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f947b52-3edf-41f1-a241-c2ac2a49359a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:31:59.653Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f947b52-3edf-41f1-a241-c2ac2a49359a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35a445b3 2021-04-14T12:31:59.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f947b52-3edf-41f1-a241-c2ac2a49359a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:31:59.654Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f947b52-3edf-41f1-a241-c2ac2a49359a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:02.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1769ef32-d078-4050-9301-c259c541b241 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:02.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1769ef32-d078-4050-9301-c259c541b241 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c3f0283 2021-04-14T12:32:02.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1769ef32-d078-4050-9301-c259c541b241 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:02.715Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1769ef32-d078-4050-9301-c259c541b241 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:32:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:32:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:32:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:32:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:32:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:32:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff3be3b-c59c-4bb3-9321-605802289593 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff3be3b-c59c-4bb3-9321-605802289593 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d792ddf 2021-04-14T12:32:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff3be3b-c59c-4bb3-9321-605802289593 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aff3be3b-c59c-4bb3-9321-605802289593 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:06.236Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0f537667-803e-4e0c-b398-2cc4a7d236ba InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:32:06.236366Z InvocationID=e24216c4-f6c5-4fb2-a28d-738d693e381b LogTimestamp=2021-04-14T12:32:06.236425Z Entering 2021-04-14T12:32:06.236Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0f537667-803e-4e0c-b398-2cc4a7d236ba InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:32:06.236366Z InvocationID=e24216c4-f6c5-4fb2-a28d-738d693e381b LogTimestamp=2021-04-14T12:32:06.236425Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:32:06.238Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:32:06.237Z InvocationID=ddee0287-6ba7-4bbd-9469-fc9330bd7693 LogTimestamp=2021-04-14T12:32:06.238218Z ResponseDesc=OK Exiting. 2021-04-14T12:32:06.238Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:32:09.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2dbdc67a-de43-4cd2-8e80-a0218c6583bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:09.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2dbdc67a-de43-4cd2-8e80-a0218c6583bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53204014 2021-04-14T12:32:09.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2dbdc67a-de43-4cd2-8e80-a0218c6583bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:09.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2dbdc67a-de43-4cd2-8e80-a0218c6583bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d20b9e2-289f-4a40-89a5-d04cff4cead8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d20b9e2-289f-4a40-89a5-d04cff4cead8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@443e0e1e 2021-04-14T12:32:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d20b9e2-289f-4a40-89a5-d04cff4cead8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d20b9e2-289f-4a40-89a5-d04cff4cead8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bc7bfb-6e65-4d87-8079-97736fdae5e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bc7bfb-6e65-4d87-8079-97736fdae5e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@513700 2021-04-14T12:32:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bc7bfb-6e65-4d87-8079-97736fdae5e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81bc7bfb-6e65-4d87-8079-97736fdae5e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:16.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:17.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4808bc80-ae2b-4a24-a6dc-d9f3efa0989b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:17.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4808bc80-ae2b-4a24-a6dc-d9f3efa0989b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6422f500 2021-04-14T12:32:17.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4808bc80-ae2b-4a24-a6dc-d9f3efa0989b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:17.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4808bc80-ae2b-4a24-a6dc-d9f3efa0989b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc57c88-e28d-4304-8fe4-8d1483a285ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc57c88-e28d-4304-8fe4-8d1483a285ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35d33970 2021-04-14T12:32:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc57c88-e28d-4304-8fe4-8d1483a285ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc57c88-e28d-4304-8fe4-8d1483a285ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd187ab-380a-45c2-b52c-af36e2273fbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd187ab-380a-45c2-b52c-af36e2273fbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1299f2a 2021-04-14T12:32:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd187ab-380a-45c2-b52c-af36e2273fbb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecd187ab-380a-45c2-b52c-af36e2273fbb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:27.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1bf86b-7657-4244-aa30-06b713cd3668 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:27.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1bf86b-7657-4244-aa30-06b713cd3668 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8494138 2021-04-14T12:32:27.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1bf86b-7657-4244-aa30-06b713cd3668 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:27.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e1bf86b-7657-4244-aa30-06b713cd3668 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa5db96-15b2-45e1-8d23-c82d5c1babae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa5db96-15b2-45e1-8d23-c82d5c1babae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bb02fc4 2021-04-14T12:32:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa5db96-15b2-45e1-8d23-c82d5c1babae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1aa5db96-15b2-45e1-8d23-c82d5c1babae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:33.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ecad27-c289-48d1-a583-d348005ad4b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:33.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ecad27-c289-48d1-a583-d348005ad4b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5784917b 2021-04-14T12:32:33.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ecad27-c289-48d1-a583-d348005ad4b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:33.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7ecad27-c289-48d1-a583-d348005ad4b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:35.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180efd71-3625-4a33-8491-4c3d428678f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:35.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180efd71-3625-4a33-8491-4c3d428678f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a19946e 2021-04-14T12:32:35.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180efd71-3625-4a33-8491-4c3d428678f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:35.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180efd71-3625-4a33-8491-4c3d428678f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:36.238Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=05c79175-aed8-453b-bcc2-12a48f2189c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:32:36.237833Z InvocationID=ec0f27a8-0cfc-4077-8f39-d83bd34011d3 LogTimestamp=2021-04-14T12:32:36.237958Z Entering 2021-04-14T12:32:36.238Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=05c79175-aed8-453b-bcc2-12a48f2189c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:32:36.237833Z InvocationID=ec0f27a8-0cfc-4077-8f39-d83bd34011d3 LogTimestamp=2021-04-14T12:32:36.237958Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:32:36.240Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:32:36.238Z InvocationID=752ff54b-3183-4cc6-bb47-306a188b6762 LogTimestamp=2021-04-14T12:32:36.240527Z ResponseDesc=OK Exiting. 2021-04-14T12:32:36.240Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:32:38.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e33fcbc5-d4c3-4287-a3dc-b748802dd203 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:38.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e33fcbc5-d4c3-4287-a3dc-b748802dd203 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@589b4694 2021-04-14T12:32:38.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e33fcbc5-d4c3-4287-a3dc-b748802dd203 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:38.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e33fcbc5-d4c3-4287-a3dc-b748802dd203 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:41.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7f8f4a-21d8-4cd0-a6fc-3d989faf94ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:41.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7f8f4a-21d8-4cd0-a6fc-3d989faf94ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@222f8c4c 2021-04-14T12:32:41.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7f8f4a-21d8-4cd0-a6fc-3d989faf94ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:41.573Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb7f8f4a-21d8-4cd0-a6fc-3d989faf94ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27169a4d-53e1-472a-ad6f-942982972834 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27169a4d-53e1-472a-ad6f-942982972834 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51d3ce3b 2021-04-14T12:32:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27169a4d-53e1-472a-ad6f-942982972834 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27169a4d-53e1-472a-ad6f-942982972834 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:32:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:32:47.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0a545b-65d3-4535-a622-fa234dfeb202 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:47.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0a545b-65d3-4535-a622-fa234dfeb202 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73f8a8b 2021-04-14T12:32:47.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0a545b-65d3-4535-a622-fa234dfeb202 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:47.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b0a545b-65d3-4535-a622-fa234dfeb202 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad415e76-94f6-44f2-b747-a9177290afaa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad415e76-94f6-44f2-b747-a9177290afaa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@512d31e 2021-04-14T12:32:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad415e76-94f6-44f2-b747-a9177290afaa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad415e76-94f6-44f2-b747-a9177290afaa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c52dc707-d9fd-4d48-a546-a2d596d7b209 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c52dc707-d9fd-4d48-a546-a2d596d7b209 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b01721c 2021-04-14T12:32:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c52dc707-d9fd-4d48-a546-a2d596d7b209 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c52dc707-d9fd-4d48-a546-a2d596d7b209 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:56.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c1fd06-fc85-4b13-a3bb-5b51ff5ae9d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c1fd06-fc85-4b13-a3bb-5b51ff5ae9d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14eccd51 2021-04-14T12:32:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c1fd06-fc85-4b13-a3bb-5b51ff5ae9d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=03c1fd06-fc85-4b13-a3bb-5b51ff5ae9d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:32:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ad5594-c2b1-4a00-af2b-698b9108db70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:32:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ad5594-c2b1-4a00-af2b-698b9108db70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ffc7695 2021-04-14T12:32:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ad5594-c2b1-4a00-af2b-698b9108db70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:32:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91ad5594-c2b1-4a00-af2b-698b9108db70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40c5c528-3a0a-49f3-8896-236898cab6e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40c5c528-3a0a-49f3-8896-236898cab6e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ce5d257 2021-04-14T12:33:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40c5c528-3a0a-49f3-8896-236898cab6e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40c5c528-3a0a-49f3-8896-236898cab6e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:33:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:33:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:33:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:33:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:33:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:33:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be0a0bb-a033-4281-ae3f-94d097af367c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be0a0bb-a033-4281-ae3f-94d097af367c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c24ce45 2021-04-14T12:33:06.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be0a0bb-a033-4281-ae3f-94d097af367c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:06.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be0a0bb-a033-4281-ae3f-94d097af367c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:06.233Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d7eeeca4-a487-44d1-9db8-5093dd7dd5e8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:33:06.232671Z InvocationID=cf2b8206-0c79-4ee2-85d6-8e0ac2613b90 LogTimestamp=2021-04-14T12:33:06.232741Z Entering 2021-04-14T12:33:06.233Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d7eeeca4-a487-44d1-9db8-5093dd7dd5e8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:33:06.232671Z InvocationID=cf2b8206-0c79-4ee2-85d6-8e0ac2613b90 LogTimestamp=2021-04-14T12:33:06.232741Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:33:06.234Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:33:06.233Z InvocationID=fdef4afe-c5b9-40fe-9805-5e98efdaa150 LogTimestamp=2021-04-14T12:33:06.234482Z ResponseDesc=OK Exiting. 2021-04-14T12:33:06.234Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:33:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319e168a-939d-46ee-bfe0-e649b76568d8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319e168a-939d-46ee-bfe0-e649b76568d8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ed018d5 2021-04-14T12:33:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319e168a-939d-46ee-bfe0-e649b76568d8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=319e168a-939d-46ee-bfe0-e649b76568d8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feb0b656-852f-481d-a684-936b394b5873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feb0b656-852f-481d-a684-936b394b5873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52149544 2021-04-14T12:33:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feb0b656-852f-481d-a684-936b394b5873 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=feb0b656-852f-481d-a684-936b394b5873 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:14.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c4974c-2ed4-4212-9f90-54b810625fb9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:14.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c4974c-2ed4-4212-9f90-54b810625fb9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b1823b 2021-04-14T12:33:14.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c4974c-2ed4-4212-9f90-54b810625fb9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:14.691Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c0c4974c-2ed4-4212-9f90-54b810625fb9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:17.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae49718a-043d-4e61-9309-42d9649f627b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:17.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae49718a-043d-4e61-9309-42d9649f627b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a6d228e 2021-04-14T12:33:17.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae49718a-043d-4e61-9309-42d9649f627b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:17.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae49718a-043d-4e61-9309-42d9649f627b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817eb57f-4cad-42fa-a98d-ddb85a433c81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817eb57f-4cad-42fa-a98d-ddb85a433c81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@542585a6 2021-04-14T12:33:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817eb57f-4cad-42fa-a98d-ddb85a433c81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=817eb57f-4cad-42fa-a98d-ddb85a433c81 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d0daba-4435-4e71-b0de-d7766eabb88f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d0daba-4435-4e71-b0de-d7766eabb88f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@226d84d3 2021-04-14T12:33:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d0daba-4435-4e71-b0de-d7766eabb88f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:24.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d0daba-4435-4e71-b0de-d7766eabb88f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:26.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc548911-17ba-41f3-92e6-de301f1a583e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:26.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc548911-17ba-41f3-92e6-de301f1a583e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ec16aff 2021-04-14T12:33:26.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc548911-17ba-41f3-92e6-de301f1a583e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:26.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc548911-17ba-41f3-92e6-de301f1a583e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:30.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f091564d-7f10-48f9-837f-c25e4f6977b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f091564d-7f10-48f9-837f-c25e4f6977b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ddb54fb 2021-04-14T12:33:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f091564d-7f10-48f9-837f-c25e4f6977b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:30.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f091564d-7f10-48f9-837f-c25e4f6977b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdc89dbf-d068-4a86-a2c8-0c7fc75636af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:33.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdc89dbf-d068-4a86-a2c8-0c7fc75636af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35abf053 2021-04-14T12:33:33.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdc89dbf-d068-4a86-a2c8-0c7fc75636af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:33.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bdc89dbf-d068-4a86-a2c8-0c7fc75636af PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8205b5-059c-4a62-96cd-757273c0a92a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8205b5-059c-4a62-96cd-757273c0a92a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b2eb129 2021-04-14T12:33:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8205b5-059c-4a62-96cd-757273c0a92a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b8205b5-059c-4a62-96cd-757273c0a92a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:36.257Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7e393ac5-3065-4f2a-8b82-2d5a8d40da35 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:33:36.256620Z InvocationID=143122c7-b61e-451a-82f0-3563d37fa0b8 LogTimestamp=2021-04-14T12:33:36.256774Z Entering 2021-04-14T12:33:36.257Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7e393ac5-3065-4f2a-8b82-2d5a8d40da35 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:33:36.256620Z InvocationID=143122c7-b61e-451a-82f0-3563d37fa0b8 LogTimestamp=2021-04-14T12:33:36.256774Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:33:36.261Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:33:36.258Z InvocationID=fdcb5c9f-b360-4436-813b-680d3c82fee4 LogTimestamp=2021-04-14T12:33:36.261166Z ResponseDesc=OK Exiting. 2021-04-14T12:33:36.261Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:33:38.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=953634e0-0494-4e12-bf66-49967068cb28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:38.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=953634e0-0494-4e12-bf66-49967068cb28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e1dba21 2021-04-14T12:33:38.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=953634e0-0494-4e12-bf66-49967068cb28 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:38.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=953634e0-0494-4e12-bf66-49967068cb28 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb8b37f-a03c-4423-9fec-7ac09279ee26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb8b37f-a03c-4423-9fec-7ac09279ee26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49765195 2021-04-14T12:33:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb8b37f-a03c-4423-9fec-7ac09279ee26 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb8b37f-a03c-4423-9fec-7ac09279ee26 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c446ea-8047-46f4-8720-4628fb1c6db5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c446ea-8047-46f4-8720-4628fb1c6db5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23b50980 2021-04-14T12:33:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c446ea-8047-46f4-8720-4628fb1c6db5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c446ea-8047-46f4-8720-4628fb1c6db5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:33:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:33:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a46b9b-85c6-450c-91a3-269da1b91b45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a46b9b-85c6-450c-91a3-269da1b91b45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d1c5326 2021-04-14T12:33:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a46b9b-85c6-450c-91a3-269da1b91b45 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:47.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61a46b9b-85c6-450c-91a3-269da1b91b45 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:48.222Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4e854653-2d7a-4b1f-b494-57c28e0b0845 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:33:48.222337Z InvocationID=9b0f4303-e363-4e54-a1f8-743cf8433024 LogTimestamp=2021-04-14T12:33:48.222385Z Entering 2021-04-14T12:33:48.222Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4e854653-2d7a-4b1f-b494-57c28e0b0845 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:33:48.222337Z InvocationID=9b0f4303-e363-4e54-a1f8-743cf8433024 LogTimestamp=2021-04-14T12:33:48.222385Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:33:48.224Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:33:48.222Z InvocationID=630c55fe-faa0-438a-8d4f-fca465738a13 LogTimestamp=2021-04-14T12:33:48.224436Z ResponseDesc=OK Exiting. 2021-04-14T12:33:48.224Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:33:51.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22fe349-e23d-4ece-adef-e2663dcf5edb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:51.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22fe349-e23d-4ece-adef-e2663dcf5edb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ee32816 2021-04-14T12:33:51.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22fe349-e23d-4ece-adef-e2663dcf5edb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:51.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e22fe349-e23d-4ece-adef-e2663dcf5edb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:53.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd51b68-a672-4112-9c9c-7f15087bb491 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:53.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd51b68-a672-4112-9c9c-7f15087bb491 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@656228a6 2021-04-14T12:33:53.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd51b68-a672-4112-9c9c-7f15087bb491 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:53.955Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd51b68-a672-4112-9c9c-7f15087bb491 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:56.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91b821b-83b8-47f6-9878-5675e6459d12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:56.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91b821b-83b8-47f6-9878-5675e6459d12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e10d483 2021-04-14T12:33:56.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91b821b-83b8-47f6-9878-5675e6459d12 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:56.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b91b821b-83b8-47f6-9878-5675e6459d12 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:33:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4160db3-1447-45dd-b368-182c4e8ccf7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:33:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4160db3-1447-45dd-b368-182c4e8ccf7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@215a2f04 2021-04-14T12:33:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4160db3-1447-45dd-b368-182c4e8ccf7c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:33:59.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4160db3-1447-45dd-b368-182c4e8ccf7c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d86fdb4-fa23-4012-8c9d-69d507c9e60e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d86fdb4-fa23-4012-8c9d-69d507c9e60e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26fe10a1 2021-04-14T12:34:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d86fdb4-fa23-4012-8c9d-69d507c9e60e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d86fdb4-fa23-4012-8c9d-69d507c9e60e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:34:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:34:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:34:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:34:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:34:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:34:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40f0784-c9a6-4849-8a65-8ca0f4ce6e6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40f0784-c9a6-4849-8a65-8ca0f4ce6e6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52ad2bc0 2021-04-14T12:34:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40f0784-c9a6-4849-8a65-8ca0f4ce6e6f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40f0784-c9a6-4849-8a65-8ca0f4ce6e6f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:06.247Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0fe4d31e-16b7-47f1-92d2-d575f76a5a33 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:06.246568Z InvocationID=24628162-f911-45a8-9db1-adad9edc3fc1 LogTimestamp=2021-04-14T12:34:06.246683Z Entering 2021-04-14T12:34:06.247Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0fe4d31e-16b7-47f1-92d2-d575f76a5a33 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:06.246568Z InvocationID=24628162-f911-45a8-9db1-adad9edc3fc1 LogTimestamp=2021-04-14T12:34:06.246683Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:34:06.249Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:34:06.247Z InvocationID=a50c7f1b-463b-4d0a-bc27-0d961fdca863 LogTimestamp=2021-04-14T12:34:06.249769Z ResponseDesc=OK Exiting. 2021-04-14T12:34:06.250Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:34:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18161289-984b-4282-8676-0e44d8c6a2e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18161289-984b-4282-8676-0e44d8c6a2e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a7159da 2021-04-14T12:34:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18161289-984b-4282-8676-0e44d8c6a2e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18161289-984b-4282-8676-0e44d8c6a2e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69acc918-9185-457e-b084-3383ab662111 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69acc918-9185-457e-b084-3383ab662111 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4aa3739f 2021-04-14T12:34:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69acc918-9185-457e-b084-3383ab662111 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69acc918-9185-457e-b084-3383ab662111 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b623ac3d-7ba3-46d0-9121-fbbf5f94be3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b623ac3d-7ba3-46d0-9121-fbbf5f94be3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c0e0972 2021-04-14T12:34:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b623ac3d-7ba3-46d0-9121-fbbf5f94be3a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:14.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b623ac3d-7ba3-46d0-9121-fbbf5f94be3a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:17.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb7be5-85f9-4f26-93a5-354b14aebfa7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:17.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb7be5-85f9-4f26-93a5-354b14aebfa7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27c6d218 2021-04-14T12:34:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb7be5-85f9-4f26-93a5-354b14aebfa7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7bcb7be5-85f9-4f26-93a5-354b14aebfa7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1eebc-2610-42bc-8d99-337ca24fe3b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1eebc-2610-42bc-8d99-337ca24fe3b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17c9e0b3 2021-04-14T12:34:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1eebc-2610-42bc-8d99-337ca24fe3b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a1eebc-2610-42bc-8d99-337ca24fe3b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:24.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e747ef83-f91b-497a-9500-b08007649c98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:24.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e747ef83-f91b-497a-9500-b08007649c98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4627465e 2021-04-14T12:34:24.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e747ef83-f91b-497a-9500-b08007649c98 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:24.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e747ef83-f91b-497a-9500-b08007649c98 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:27.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaf51611-27dc-4d62-94b1-92850277f671 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:27.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaf51611-27dc-4d62-94b1-92850277f671 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a0e9271 2021-04-14T12:34:27.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaf51611-27dc-4d62-94b1-92850277f671 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:27.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaf51611-27dc-4d62-94b1-92850277f671 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:28.169Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=88fa8a49-594f-4f7d-90b1-5027bb1d89e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:28.169079Z InvocationID=61bba007-60ec-477f-b93f-3a65909d04b7 LogTimestamp=2021-04-14T12:34:28.169137Z Entering 2021-04-14T12:34:28.169Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=88fa8a49-594f-4f7d-90b1-5027bb1d89e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:28.169079Z InvocationID=61bba007-60ec-477f-b93f-3a65909d04b7 LogTimestamp=2021-04-14T12:34:28.169137Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:34:28.170Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:34:28.169Z InvocationID=97d35d08-eda8-4d03-9098-f49cc6909e3c LogTimestamp=2021-04-14T12:34:28.170638Z ResponseDesc=OK Exiting. 2021-04-14T12:34:28.171Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:34:28.491Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=33c9e7ac-ba45-4a01-9a87-d8d28818491d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:28.491102Z InvocationID=53398ce2-cab1-49f8-b6a0-73af81bd60f2 LogTimestamp=2021-04-14T12:34:28.491137Z Entering 2021-04-14T12:34:28.491Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=33c9e7ac-ba45-4a01-9a87-d8d28818491d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:28.491102Z InvocationID=53398ce2-cab1-49f8-b6a0-73af81bd60f2 LogTimestamp=2021-04-14T12:34:28.491137Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:34:28.492Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:34:28.491Z InvocationID=a7a8bfd7-dea4-4cdb-9dcd-6828e3a9a4ec LogTimestamp=2021-04-14T12:34:28.492346Z ResponseDesc=OK Exiting. 2021-04-14T12:34:28.492Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:34:30.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62f3e5e8-181d-4c06-8ce0-93bb5364a61f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:30.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62f3e5e8-181d-4c06-8ce0-93bb5364a61f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b49d33a 2021-04-14T12:34:30.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62f3e5e8-181d-4c06-8ce0-93bb5364a61f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:30.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62f3e5e8-181d-4c06-8ce0-93bb5364a61f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:33.326Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f71c7c79-72e8-41a1-96c4-0c6213048664 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f71c7c79-72e8-41a1-96c4-0c6213048664 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@635d6098 2021-04-14T12:34:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f71c7c79-72e8-41a1-96c4-0c6213048664 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:33.327Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f71c7c79-72e8-41a1-96c4-0c6213048664 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09db5ff2-b3c0-46d9-9d32-51593da0e6a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09db5ff2-b3c0-46d9-9d32-51593da0e6a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f34df1b 2021-04-14T12:34:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09db5ff2-b3c0-46d9-9d32-51593da0e6a9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:36.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09db5ff2-b3c0-46d9-9d32-51593da0e6a9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:36.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=485174ed-98f8-4af7-971a-6d47089dab56 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:36.236587Z InvocationID=153d90af-8ccf-480c-a521-9eecca62147a LogTimestamp=2021-04-14T12:34:36.236622Z Entering 2021-04-14T12:34:36.236Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=485174ed-98f8-4af7-971a-6d47089dab56 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:34:36.236587Z InvocationID=153d90af-8ccf-480c-a521-9eecca62147a LogTimestamp=2021-04-14T12:34:36.236622Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:34:36.238Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:34:36.237Z InvocationID=714ea994-7435-4033-aae9-b73c87e38472 LogTimestamp=2021-04-14T12:34:36.238560Z ResponseDesc=OK Exiting. 2021-04-14T12:34:36.238Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:34:38.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173e78a-0270-4c67-979f-7006edf09e08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:38.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173e78a-0270-4c67-979f-7006edf09e08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41f74b96 2021-04-14T12:34:38.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173e78a-0270-4c67-979f-7006edf09e08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:38.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173e78a-0270-4c67-979f-7006edf09e08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:41.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eade5a77-9307-4e79-9c99-7bebde2b7612 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:41.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eade5a77-9307-4e79-9c99-7bebde2b7612 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34528091 2021-04-14T12:34:41.602Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eade5a77-9307-4e79-9c99-7bebde2b7612 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:41.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eade5a77-9307-4e79-9c99-7bebde2b7612 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf906d9-e436-455f-bc4b-020c90ac575e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf906d9-e436-455f-bc4b-020c90ac575e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c036f23 2021-04-14T12:34:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf906d9-e436-455f-bc4b-020c90ac575e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edf906d9-e436-455f-bc4b-020c90ac575e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:34:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:34:47.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e926912-201a-4517-af35-65b7023ba7be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:47.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e926912-201a-4517-af35-65b7023ba7be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f6b3bf 2021-04-14T12:34:47.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e926912-201a-4517-af35-65b7023ba7be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:47.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e926912-201a-4517-af35-65b7023ba7be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:51.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4986318b-c0c3-48f9-959a-d58090fe065f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:51.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4986318b-c0c3-48f9-959a-d58090fe065f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e26f36c 2021-04-14T12:34:51.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4986318b-c0c3-48f9-959a-d58090fe065f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:51.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4986318b-c0c3-48f9-959a-d58090fe065f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e78d37-fabf-4f94-a6dd-6aca23ae9c8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e78d37-fabf-4f94-a6dd-6aca23ae9c8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e50b231 2021-04-14T12:34:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e78d37-fabf-4f94-a6dd-6aca23ae9c8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69e78d37-fabf-4f94-a6dd-6aca23ae9c8f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:56.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e97365b-156e-4e34-a3fa-6c6d85e2c227 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:56.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e97365b-156e-4e34-a3fa-6c6d85e2c227 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@798da4af 2021-04-14T12:34:56.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e97365b-156e-4e34-a3fa-6c6d85e2c227 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:56.940Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e97365b-156e-4e34-a3fa-6c6d85e2c227 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:34:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e658d47e-bd07-45ef-8045-165cf913e52c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:34:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e658d47e-bd07-45ef-8045-165cf913e52c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49d68b6a 2021-04-14T12:34:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e658d47e-bd07-45ef-8045-165cf913e52c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:34:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e658d47e-bd07-45ef-8045-165cf913e52c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0286-6ddc-4cd9-8d62-a6336cd7589e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0286-6ddc-4cd9-8d62-a6336cd7589e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a2acaf 2021-04-14T12:35:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0286-6ddc-4cd9-8d62-a6336cd7589e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:02.725Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3cda0286-6ddc-4cd9-8d62-a6336cd7589e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:04.353Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:35:04.353Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:35:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:35:04.354Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:35:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:35:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:35:06.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb743394-870a-4e4e-b1e7-ed406b0baa3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:06.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb743394-870a-4e4e-b1e7-ed406b0baa3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b3847b0 2021-04-14T12:35:06.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb743394-870a-4e4e-b1e7-ed406b0baa3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:06.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb743394-870a-4e4e-b1e7-ed406b0baa3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:06.231Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6d3b4725-cd7f-4ea5-826c-95d1c063624c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:35:06.231169Z InvocationID=7efaaa16-3185-47b4-90d2-739f3763dfd7 LogTimestamp=2021-04-14T12:35:06.231232Z Entering 2021-04-14T12:35:06.231Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6d3b4725-cd7f-4ea5-826c-95d1c063624c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:35:06.231169Z InvocationID=7efaaa16-3185-47b4-90d2-739f3763dfd7 LogTimestamp=2021-04-14T12:35:06.231232Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:35:06.234Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:35:06.232Z InvocationID=a780aab2-7206-49d5-8009-837608404849 LogTimestamp=2021-04-14T12:35:06.234109Z ResponseDesc=OK Exiting. 2021-04-14T12:35:06.235Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:35:09.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e379bc09-7a8c-491b-8d20-a173d1b8d262 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:09.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e379bc09-7a8c-491b-8d20-a173d1b8d262 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f8428a4 2021-04-14T12:35:09.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e379bc09-7a8c-491b-8d20-a173d1b8d262 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:09.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e379bc09-7a8c-491b-8d20-a173d1b8d262 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:11.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4575f6a6-daf0-4a33-93b0-bb7ad9c35a3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:11.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4575f6a6-daf0-4a33-93b0-bb7ad9c35a3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32f467e5 2021-04-14T12:35:11.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4575f6a6-daf0-4a33-93b0-bb7ad9c35a3b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:11.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4575f6a6-daf0-4a33-93b0-bb7ad9c35a3b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a01a6525-97e7-4fb9-b331-6f85e46216b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a01a6525-97e7-4fb9-b331-6f85e46216b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27a672c0 2021-04-14T12:35:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a01a6525-97e7-4fb9-b331-6f85e46216b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a01a6525-97e7-4fb9-b331-6f85e46216b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:16.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:16.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:16.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:16.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:18.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d52ccb34-e70f-4c21-ad1c-acc2c3e732f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:18.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d52ccb34-e70f-4c21-ad1c-acc2c3e732f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ebaa443 2021-04-14T12:35:18.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d52ccb34-e70f-4c21-ad1c-acc2c3e732f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:18.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d52ccb34-e70f-4c21-ad1c-acc2c3e732f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:20.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cfc879-71c2-4566-aba4-7aaea5316bc6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:20.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cfc879-71c2-4566-aba4-7aaea5316bc6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50957a38 2021-04-14T12:35:20.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cfc879-71c2-4566-aba4-7aaea5316bc6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:20.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59cfc879-71c2-4566-aba4-7aaea5316bc6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:24.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e5736b-fe2b-42ba-843f-26c4eef9c4a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:24.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e5736b-fe2b-42ba-843f-26c4eef9c4a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41cff480 2021-04-14T12:35:24.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e5736b-fe2b-42ba-843f-26c4eef9c4a9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:24.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e5736b-fe2b-42ba-843f-26c4eef9c4a9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:26.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fa93aaf-3177-4f03-a0b1-a9f5ab65cd92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:26.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fa93aaf-3177-4f03-a0b1-a9f5ab65cd92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@556bae0b 2021-04-14T12:35:26.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fa93aaf-3177-4f03-a0b1-a9f5ab65cd92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:26.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fa93aaf-3177-4f03-a0b1-a9f5ab65cd92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0053e79-96b7-47f2-aa7c-a0f60327f299 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0053e79-96b7-47f2-aa7c-a0f60327f299 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e988059 2021-04-14T12:35:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0053e79-96b7-47f2-aa7c-a0f60327f299 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0053e79-96b7-47f2-aa7c-a0f60327f299 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28e62a12-51bc-4ea2-8f04-91d6d3f7a937 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28e62a12-51bc-4ea2-8f04-91d6d3f7a937 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45277908 2021-04-14T12:35:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28e62a12-51bc-4ea2-8f04-91d6d3f7a937 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28e62a12-51bc-4ea2-8f04-91d6d3f7a937 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:36.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25eef047-fdfd-46bb-8180-ec373589633e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:36.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25eef047-fdfd-46bb-8180-ec373589633e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bf2fed8 2021-04-14T12:35:36.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25eef047-fdfd-46bb-8180-ec373589633e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:36.008Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25eef047-fdfd-46bb-8180-ec373589633e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:36.239Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f0fb281d-ad07-4402-b504-5b6b1022e381 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:35:36.239308Z InvocationID=a36c294b-7701-48a9-a041-bfee8454a31e LogTimestamp=2021-04-14T12:35:36.239380Z Entering 2021-04-14T12:35:36.239Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f0fb281d-ad07-4402-b504-5b6b1022e381 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:35:36.239308Z InvocationID=a36c294b-7701-48a9-a041-bfee8454a31e LogTimestamp=2021-04-14T12:35:36.239380Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:35:36.241Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:35:36.239Z InvocationID=c5099ad2-7d81-4317-9dde-622d28b885e8 LogTimestamp=2021-04-14T12:35:36.241513Z ResponseDesc=OK Exiting. 2021-04-14T12:35:36.241Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:35:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d34643-9909-4bae-a613-a4d41cfad79d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d34643-9909-4bae-a613-a4d41cfad79d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73e11c5b 2021-04-14T12:35:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d34643-9909-4bae-a613-a4d41cfad79d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8d34643-9909-4bae-a613-a4d41cfad79d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:41.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7e6315c-e50b-49b6-868b-2daa41368236 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:41.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7e6315c-e50b-49b6-868b-2daa41368236 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@981c036 2021-04-14T12:35:41.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7e6315c-e50b-49b6-868b-2daa41368236 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:41.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7e6315c-e50b-49b6-868b-2daa41368236 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:44.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f21cfe44-e84b-4cc2-b603-25be787dc257 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:44.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f21cfe44-e84b-4cc2-b603-25be787dc257 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77900737 2021-04-14T12:35:44.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f21cfe44-e84b-4cc2-b603-25be787dc257 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:44.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f21cfe44-e84b-4cc2-b603-25be787dc257 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:35:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:35:48.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42a6edb1-26d1-49e2-84f7-457fa8ab0959 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:48.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42a6edb1-26d1-49e2-84f7-457fa8ab0959 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b783323 2021-04-14T12:35:48.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42a6edb1-26d1-49e2-84f7-457fa8ab0959 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:48.003Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42a6edb1-26d1-49e2-84f7-457fa8ab0959 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:48.221Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c79f340c-c7bd-4acd-887d-0353bbf4237f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:35:48.221395Z InvocationID=4bf40ecc-bf09-4f14-8a4a-c3e9f459491a LogTimestamp=2021-04-14T12:35:48.221478Z Entering 2021-04-14T12:35:48.222Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c79f340c-c7bd-4acd-887d-0353bbf4237f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:35:48.221395Z InvocationID=4bf40ecc-bf09-4f14-8a4a-c3e9f459491a LogTimestamp=2021-04-14T12:35:48.221478Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:35:48.223Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:35:48.222Z InvocationID=e9b6508d-3738-4c81-9ebb-8b6ec10deb1c LogTimestamp=2021-04-14T12:35:48.223718Z ResponseDesc=OK Exiting. 2021-04-14T12:35:48.224Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:35:51.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edea46e-b21d-4be5-ad3b-849a7784c878 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:51.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edea46e-b21d-4be5-ad3b-849a7784c878 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6000e7d3 2021-04-14T12:35:51.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edea46e-b21d-4be5-ad3b-849a7784c878 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:51.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edea46e-b21d-4be5-ad3b-849a7784c878 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4ae642-c721-4dd5-8f46-244950725c3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4ae642-c721-4dd5-8f46-244950725c3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67070b95 2021-04-14T12:35:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4ae642-c721-4dd5-8f46-244950725c3c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4ae642-c721-4dd5-8f46-244950725c3c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc8497e6-c9ba-42f2-bfed-62a91fec221d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc8497e6-c9ba-42f2-bfed-62a91fec221d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@105911fd 2021-04-14T12:35:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc8497e6-c9ba-42f2-bfed-62a91fec221d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc8497e6-c9ba-42f2-bfed-62a91fec221d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:35:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e0f55a4-e84d-485e-bdb9-89d9cb05f4e2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:35:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e0f55a4-e84d-485e-bdb9-89d9cb05f4e2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae2c9fe 2021-04-14T12:35:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e0f55a4-e84d-485e-bdb9-89d9cb05f4e2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:35:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e0f55a4-e84d-485e-bdb9-89d9cb05f4e2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8fde25f-5afc-41d1-9a1b-f16477456930 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8fde25f-5afc-41d1-9a1b-f16477456930 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d3b910e 2021-04-14T12:36:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8fde25f-5afc-41d1-9a1b-f16477456930 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8fde25f-5afc-41d1-9a1b-f16477456930 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:36:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:36:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:36:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:36:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:36:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:36:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c6d7b9-04ce-4959-8ae1-9ea3c2ab0afe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:06.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c6d7b9-04ce-4959-8ae1-9ea3c2ab0afe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@723f6c9f 2021-04-14T12:36:06.192Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c6d7b9-04ce-4959-8ae1-9ea3c2ab0afe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:06.200Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c6d7b9-04ce-4959-8ae1-9ea3c2ab0afe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:06.232Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=43fd0049-735a-4eb7-8e13-d7e797986e1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:36:06.232539Z InvocationID=73349cac-fb59-4f61-bb68-e11e58621ff4 LogTimestamp=2021-04-14T12:36:06.232590Z Entering 2021-04-14T12:36:06.232Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=43fd0049-735a-4eb7-8e13-d7e797986e1c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:36:06.232539Z InvocationID=73349cac-fb59-4f61-bb68-e11e58621ff4 LogTimestamp=2021-04-14T12:36:06.232590Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:36:06.234Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:36:06.233Z InvocationID=367419a8-99f2-428b-9175-0661b89b854a LogTimestamp=2021-04-14T12:36:06.234150Z ResponseDesc=OK Exiting. 2021-04-14T12:36:06.234Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:36:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49eb250-6bf6-45d6-91ab-6d9d514bc8ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49eb250-6bf6-45d6-91ab-6d9d514bc8ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ab14ddc 2021-04-14T12:36:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49eb250-6bf6-45d6-91ab-6d9d514bc8ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c49eb250-6bf6-45d6-91ab-6d9d514bc8ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f09a31-63f0-43a7-924d-40cfc92f91c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f09a31-63f0-43a7-924d-40cfc92f91c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76c0dc4d 2021-04-14T12:36:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f09a31-63f0-43a7-924d-40cfc92f91c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f09a31-63f0-43a7-924d-40cfc92f91c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=387e2fbb-dbb5-4745-b1a6-1b769f500891 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=387e2fbb-dbb5-4745-b1a6-1b769f500891 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@782907a 2021-04-14T12:36:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=387e2fbb-dbb5-4745-b1a6-1b769f500891 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:14.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=387e2fbb-dbb5-4745-b1a6-1b769f500891 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18152bd1-0c3d-4917-b64c-32fd318f703f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18152bd1-0c3d-4917-b64c-32fd318f703f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e505f81 2021-04-14T12:36:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18152bd1-0c3d-4917-b64c-32fd318f703f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18152bd1-0c3d-4917-b64c-32fd318f703f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=679a523e-4ada-4c12-9010-0c37c4538411 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:20.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=679a523e-4ada-4c12-9010-0c37c4538411 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e2f3c3a 2021-04-14T12:36:20.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=679a523e-4ada-4c12-9010-0c37c4538411 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:20.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=679a523e-4ada-4c12-9010-0c37c4538411 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:24.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8470c8-845a-4b41-a20a-d4cccfc0ee86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:24.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8470c8-845a-4b41-a20a-d4cccfc0ee86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5efdaf06 2021-04-14T12:36:24.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8470c8-845a-4b41-a20a-d4cccfc0ee86 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:24.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a8470c8-845a-4b41-a20a-d4cccfc0ee86 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:27.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6657abc-b436-4d10-b3d0-7d98904c80d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:27.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6657abc-b436-4d10-b3d0-7d98904c80d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4deff5e3 2021-04-14T12:36:27.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6657abc-b436-4d10-b3d0-7d98904c80d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:27.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6657abc-b436-4d10-b3d0-7d98904c80d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e86e4624-23a7-4fc0-adf6-bce70df3162a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e86e4624-23a7-4fc0-adf6-bce70df3162a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@414f1788 2021-04-14T12:36:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e86e4624-23a7-4fc0-adf6-bce70df3162a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e86e4624-23a7-4fc0-adf6-bce70df3162a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:33.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b43672-284f-4589-812d-c4a8e7ad7e09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:33.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b43672-284f-4589-812d-c4a8e7ad7e09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16d62d77 2021-04-14T12:36:33.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b43672-284f-4589-812d-c4a8e7ad7e09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:33.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52b43672-284f-4589-812d-c4a8e7ad7e09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:35.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28728729-ee97-46e6-aa89-56fd77685fb5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:35.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28728729-ee97-46e6-aa89-56fd77685fb5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25602534 2021-04-14T12:36:35.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28728729-ee97-46e6-aa89-56fd77685fb5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:35.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28728729-ee97-46e6-aa89-56fd77685fb5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:36.234Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ac243ff2-aea1-47a4-ba0c-b1086f7f9092 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:36:36.233925Z InvocationID=77075cfc-ad75-41bd-8723-9ea386d159c0 LogTimestamp=2021-04-14T12:36:36.233985Z Entering 2021-04-14T12:36:36.234Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ac243ff2-aea1-47a4-ba0c-b1086f7f9092 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:36:36.233925Z InvocationID=77075cfc-ad75-41bd-8723-9ea386d159c0 LogTimestamp=2021-04-14T12:36:36.233985Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:36:36.235Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:36:36.234Z InvocationID=51e6505c-8de4-4f24-840a-b22077fe43c9 LogTimestamp=2021-04-14T12:36:36.235423Z ResponseDesc=OK Exiting. 2021-04-14T12:36:36.235Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:36:38.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f9df43-9618-48e1-9a88-7f52aba71f3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:38.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f9df43-9618-48e1-9a88-7f52aba71f3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17929c96 2021-04-14T12:36:38.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f9df43-9618-48e1-9a88-7f52aba71f3a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:38.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75f9df43-9618-48e1-9a88-7f52aba71f3a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:41.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157437dc-45f9-4084-b7c7-998406407750 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:41.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157437dc-45f9-4084-b7c7-998406407750 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ed83abb 2021-04-14T12:36:41.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157437dc-45f9-4084-b7c7-998406407750 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:41.566Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=157437dc-45f9-4084-b7c7-998406407750 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:45.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe657b48-58d6-4c57-bf98-0d6efd4e8ee7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:45.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe657b48-58d6-4c57-bf98-0d6efd4e8ee7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9420782 2021-04-14T12:36:45.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe657b48-58d6-4c57-bf98-0d6efd4e8ee7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:45.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe657b48-58d6-4c57-bf98-0d6efd4e8ee7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:46.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:46.204Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:36:46.207Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:36:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfead357-c825-4ada-8107-e5285669e430 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfead357-c825-4ada-8107-e5285669e430 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dafda1b 2021-04-14T12:36:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfead357-c825-4ada-8107-e5285669e430 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfead357-c825-4ada-8107-e5285669e430 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:51.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a9cdd9-bd39-49ac-aeaf-39be569d0721 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a9cdd9-bd39-49ac-aeaf-39be569d0721 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e5a8514 2021-04-14T12:36:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a9cdd9-bd39-49ac-aeaf-39be569d0721 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2a9cdd9-bd39-49ac-aeaf-39be569d0721 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f4c7d57-eb99-4a63-a0c1-20e059bc43f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f4c7d57-eb99-4a63-a0c1-20e059bc43f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41387f86 2021-04-14T12:36:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f4c7d57-eb99-4a63-a0c1-20e059bc43f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f4c7d57-eb99-4a63-a0c1-20e059bc43f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=136a446e-b665-4ba8-b502-932da2e169d6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:56.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=136a446e-b665-4ba8-b502-932da2e169d6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58df0e34 2021-04-14T12:36:56.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=136a446e-b665-4ba8-b502-932da2e169d6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:56.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=136a446e-b665-4ba8-b502-932da2e169d6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:36:59.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d27a935-7014-4b96-a781-69927fb1c6f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:36:59.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d27a935-7014-4b96-a781-69927fb1c6f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bf37836 2021-04-14T12:36:59.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d27a935-7014-4b96-a781-69927fb1c6f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:36:59.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d27a935-7014-4b96-a781-69927fb1c6f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:02.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7e44efe-1be8-4a02-9823-dcdd68a63280 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:02.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7e44efe-1be8-4a02-9823-dcdd68a63280 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71fb2e79 2021-04-14T12:37:02.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7e44efe-1be8-4a02-9823-dcdd68a63280 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:02.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7e44efe-1be8-4a02-9823-dcdd68a63280 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:37:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:37:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:37:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:37:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:37:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:37:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544bfcfc-95d3-496c-aadf-0f62a77b5c95 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544bfcfc-95d3-496c-aadf-0f62a77b5c95 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@733dab8f 2021-04-14T12:37:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544bfcfc-95d3-496c-aadf-0f62a77b5c95 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=544bfcfc-95d3-496c-aadf-0f62a77b5c95 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:06.231Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e0c0ea03-a55c-41d2-921c-562211735ace InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:06.231256Z InvocationID=ef700b43-2590-4c84-a1b6-d27f48783a5b LogTimestamp=2021-04-14T12:37:06.231356Z Entering 2021-04-14T12:37:06.232Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e0c0ea03-a55c-41d2-921c-562211735ace InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:06.231256Z InvocationID=ef700b43-2590-4c84-a1b6-d27f48783a5b LogTimestamp=2021-04-14T12:37:06.231356Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:37:06.234Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:37:06.232Z InvocationID=f4670275-d23b-4c6c-8f9f-0ada4f2a8232 LogTimestamp=2021-04-14T12:37:06.234783Z ResponseDesc=OK Exiting. 2021-04-14T12:37:06.235Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:37:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccfdd9a6-7864-491f-90d3-738ac8dc3c61 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccfdd9a6-7864-491f-90d3-738ac8dc3c61 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bb12307 2021-04-14T12:37:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccfdd9a6-7864-491f-90d3-738ac8dc3c61 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccfdd9a6-7864-491f-90d3-738ac8dc3c61 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:11.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bea58ef3-3c24-4c5b-b16b-7e6cbb43b295 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:11.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bea58ef3-3c24-4c5b-b16b-7e6cbb43b295 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@754e8c2d 2021-04-14T12:37:11.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bea58ef3-3c24-4c5b-b16b-7e6cbb43b295 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:11.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bea58ef3-3c24-4c5b-b16b-7e6cbb43b295 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:11.947Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=127f819d-73fc-4d70-bb50-be10a92af5b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:11.947395Z InvocationID=2629bdfd-bfb3-4d2f-b5aa-650ea1dab5a2 LogTimestamp=2021-04-14T12:37:11.947474Z Entering 2021-04-14T12:37:11.947Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=127f819d-73fc-4d70-bb50-be10a92af5b8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:11.947395Z InvocationID=2629bdfd-bfb3-4d2f-b5aa-650ea1dab5a2 LogTimestamp=2021-04-14T12:37:11.947474Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:37:11.950Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:37:11.948Z InvocationID=c419de8c-6529-4b28-b486-e49ca0d26cce LogTimestamp=2021-04-14T12:37:11.949913Z ResponseDesc=OK Exiting. 2021-04-14T12:37:11.950Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:37:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b8de92-0adb-4f59-9a03-49157513e674 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b8de92-0adb-4f59-9a03-49157513e674 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b18afc3 2021-04-14T12:37:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b8de92-0adb-4f59-9a03-49157513e674 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:14.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44b8de92-0adb-4f59-9a03-49157513e674 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:18.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6e6416-d191-4688-9ed2-40e5fbd357ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:18.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6e6416-d191-4688-9ed2-40e5fbd357ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@726f035f 2021-04-14T12:37:18.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6e6416-d191-4688-9ed2-40e5fbd357ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:18.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da6e6416-d191-4688-9ed2-40e5fbd357ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:20.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b983181-6ff4-4e57-839c-01515821ed96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:20.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b983181-6ff4-4e57-839c-01515821ed96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10a4af0e 2021-04-14T12:37:20.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b983181-6ff4-4e57-839c-01515821ed96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:20.565Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b983181-6ff4-4e57-839c-01515821ed96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0cbc8a-f451-48e7-8d9f-ab7a372df86c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0cbc8a-f451-48e7-8d9f-ab7a372df86c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@118a76d3 2021-04-14T12:37:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0cbc8a-f451-48e7-8d9f-ab7a372df86c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b0cbc8a-f451-48e7-8d9f-ab7a372df86c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc97436d-783e-4f4c-a983-ea4ee62b3473 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc97436d-783e-4f4c-a983-ea4ee62b3473 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f12b596 2021-04-14T12:37:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc97436d-783e-4f4c-a983-ea4ee62b3473 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc97436d-783e-4f4c-a983-ea4ee62b3473 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86b759cb-a624-481f-9f1c-53830f0beb80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86b759cb-a624-481f-9f1c-53830f0beb80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65ed36d0 2021-04-14T12:37:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86b759cb-a624-481f-9f1c-53830f0beb80 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:30.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86b759cb-a624-481f-9f1c-53830f0beb80 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ae451da-481c-43b7-90a6-600d404914cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ae451da-481c-43b7-90a6-600d404914cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@508429bc 2021-04-14T12:37:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ae451da-481c-43b7-90a6-600d404914cb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:33.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ae451da-481c-43b7-90a6-600d404914cb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b61792b-0fd2-40fc-aee0-83fe7705b055 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b61792b-0fd2-40fc-aee0-83fe7705b055 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@127af191 2021-04-14T12:37:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b61792b-0fd2-40fc-aee0-83fe7705b055 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b61792b-0fd2-40fc-aee0-83fe7705b055 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:36.229Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=77d3a18e-58d7-479e-b04b-c286dd3d341c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:36.228791Z InvocationID=f6e2300d-38f6-4549-9644-ade3d9bfbb5d LogTimestamp=2021-04-14T12:37:36.228845Z Entering 2021-04-14T12:37:36.229Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=77d3a18e-58d7-479e-b04b-c286dd3d341c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:36.228791Z InvocationID=f6e2300d-38f6-4549-9644-ade3d9bfbb5d LogTimestamp=2021-04-14T12:37:36.228845Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:37:36.230Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:37:36.229Z InvocationID=c20fdca9-3b51-458d-9aa6-f745a43d8847 LogTimestamp=2021-04-14T12:37:36.230600Z ResponseDesc=OK Exiting. 2021-04-14T12:37:36.230Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:37:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dfe2fc-4a92-4333-a3ef-846c678ab5c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dfe2fc-4a92-4333-a3ef-846c678ab5c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@683e584d 2021-04-14T12:37:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dfe2fc-4a92-4333-a3ef-846c678ab5c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50dfe2fc-4a92-4333-a3ef-846c678ab5c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d3828c-481a-4f41-b63c-afef60d9df32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d3828c-481a-4f41-b63c-afef60d9df32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64e9b82c 2021-04-14T12:37:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d3828c-481a-4f41-b63c-afef60d9df32 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9d3828c-481a-4f41-b63c-afef60d9df32 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27490440-565a-4934-ad17-7ae92ffa73da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27490440-565a-4934-ad17-7ae92ffa73da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1551a4c4 2021-04-14T12:37:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27490440-565a-4934-ad17-7ae92ffa73da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27490440-565a-4934-ad17-7ae92ffa73da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:37:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:37:48.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74dfd207-5de6-4a9d-bb98-d309d561a61e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:48.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74dfd207-5de6-4a9d-bb98-d309d561a61e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50e23986 2021-04-14T12:37:48.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74dfd207-5de6-4a9d-bb98-d309d561a61e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:48.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74dfd207-5de6-4a9d-bb98-d309d561a61e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:48.207Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c842d1cb-78d4-4676-aabd-94387ee3687f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:48.207515Z InvocationID=1a851b8e-6f35-423c-b753-fcdaa3d96d40 LogTimestamp=2021-04-14T12:37:48.207578Z Entering 2021-04-14T12:37:48.208Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c842d1cb-78d4-4676-aabd-94387ee3687f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:37:48.207515Z InvocationID=1a851b8e-6f35-423c-b753-fcdaa3d96d40 LogTimestamp=2021-04-14T12:37:48.207578Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:37:48.209Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:37:48.208Z InvocationID=69f8a520-9e49-4d31-860c-184811d94c63 LogTimestamp=2021-04-14T12:37:48.209678Z ResponseDesc=OK Exiting. 2021-04-14T12:37:48.210Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:37:51.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1622b88-4571-497f-a099-e5ca4dbdca65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:51.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1622b88-4571-497f-a099-e5ca4dbdca65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a84efe7 2021-04-14T12:37:51.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1622b88-4571-497f-a099-e5ca4dbdca65 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:51.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1622b88-4571-497f-a099-e5ca4dbdca65 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:53.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775a5990-34dc-4b66-884d-9fc4ae11da8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:53.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775a5990-34dc-4b66-884d-9fc4ae11da8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63051643 2021-04-14T12:37:53.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775a5990-34dc-4b66-884d-9fc4ae11da8a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:53.855Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=775a5990-34dc-4b66-884d-9fc4ae11da8a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:56.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8b92946-b0e4-425d-aa8b-a3fc35aa8390 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:56.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8b92946-b0e4-425d-aa8b-a3fc35aa8390 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b6af963 2021-04-14T12:37:56.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8b92946-b0e4-425d-aa8b-a3fc35aa8390 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:56.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8b92946-b0e4-425d-aa8b-a3fc35aa8390 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:37:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e207fea-d12c-4e4b-8d44-04505f294ca2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:37:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e207fea-d12c-4e4b-8d44-04505f294ca2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a85c181 2021-04-14T12:37:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e207fea-d12c-4e4b-8d44-04505f294ca2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:37:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e207fea-d12c-4e4b-8d44-04505f294ca2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:03.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2945cd10-1e16-49e2-8da5-4167f8bd5dd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:03.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2945cd10-1e16-49e2-8da5-4167f8bd5dd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5713eae1 2021-04-14T12:38:03.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2945cd10-1e16-49e2-8da5-4167f8bd5dd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2945cd10-1e16-49e2-8da5-4167f8bd5dd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:38:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:38:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:38:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:38:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:38:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:38:06.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b108fb5-abee-47ad-89c3-0e1ab6465287 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:06.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b108fb5-abee-47ad-89c3-0e1ab6465287 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c6f594e 2021-04-14T12:38:06.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b108fb5-abee-47ad-89c3-0e1ab6465287 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:06.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b108fb5-abee-47ad-89c3-0e1ab6465287 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:06.237Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=844a05ce-ce2a-4b7e-8501-87aa9504f9a7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:38:06.237193Z InvocationID=299c1186-98f2-4723-9314-3b28e298ce4f LogTimestamp=2021-04-14T12:38:06.237298Z Entering 2021-04-14T12:38:06.238Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=844a05ce-ce2a-4b7e-8501-87aa9504f9a7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:38:06.237193Z InvocationID=299c1186-98f2-4723-9314-3b28e298ce4f LogTimestamp=2021-04-14T12:38:06.237298Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:38:06.239Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:38:06.238Z InvocationID=97d9b5eb-268a-470a-bd52-56c7258bafe3 LogTimestamp=2021-04-14T12:38:06.239693Z ResponseDesc=OK Exiting. 2021-04-14T12:38:06.240Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:38:08.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e26d740-30cf-46ea-8be8-6c32ee68fee6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:08.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e26d740-30cf-46ea-8be8-6c32ee68fee6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30620a41 2021-04-14T12:38:08.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e26d740-30cf-46ea-8be8-6c32ee68fee6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:08.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e26d740-30cf-46ea-8be8-6c32ee68fee6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:11.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d689b42-ccc3-494a-b2a2-316f698c6ff4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d689b42-ccc3-494a-b2a2-316f698c6ff4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24ff4c05 2021-04-14T12:38:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d689b42-ccc3-494a-b2a2-316f698c6ff4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d689b42-ccc3-494a-b2a2-316f698c6ff4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=787701c0-c80f-4f44-a51f-6548cc228f27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=787701c0-c80f-4f44-a51f-6548cc228f27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c73ee99 2021-04-14T12:38:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=787701c0-c80f-4f44-a51f-6548cc228f27 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=787701c0-c80f-4f44-a51f-6548cc228f27 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:16.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:18.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45e8fe6-9058-490f-aec1-e82cd222cc0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:18.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45e8fe6-9058-490f-aec1-e82cd222cc0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a307f70 2021-04-14T12:38:18.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45e8fe6-9058-490f-aec1-e82cd222cc0e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:18.145Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f45e8fe6-9058-490f-aec1-e82cd222cc0e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afbd3748-2a09-45ae-a78a-b6dc9a8b466c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afbd3748-2a09-45ae-a78a-b6dc9a8b466c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a204c75 2021-04-14T12:38:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afbd3748-2a09-45ae-a78a-b6dc9a8b466c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afbd3748-2a09-45ae-a78a-b6dc9a8b466c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:24.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e1fd56-665b-4ca4-9aa3-5842a5ba8bbc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:24.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e1fd56-665b-4ca4-9aa3-5842a5ba8bbc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7461b250 2021-04-14T12:38:24.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e1fd56-665b-4ca4-9aa3-5842a5ba8bbc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:24.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77e1fd56-665b-4ca4-9aa3-5842a5ba8bbc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:26.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12eb7cd1-9f8d-4a9b-94f2-b3fd250d881a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:26.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12eb7cd1-9f8d-4a9b-94f2-b3fd250d881a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7158d63 2021-04-14T12:38:26.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12eb7cd1-9f8d-4a9b-94f2-b3fd250d881a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:26.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12eb7cd1-9f8d-4a9b-94f2-b3fd250d881a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edf3fce-4e1e-4f0d-a4fe-563cd74c88ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edf3fce-4e1e-4f0d-a4fe-563cd74c88ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e57a90e 2021-04-14T12:38:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edf3fce-4e1e-4f0d-a4fe-563cd74c88ff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7edf3fce-4e1e-4f0d-a4fe-563cd74c88ff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:30.812Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f244de2a-1a09-45b3-95d3-17defaf52c22 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:38:30.812582Z InvocationID=4b099191-4eae-4fa6-bd82-58f9d78f154d LogTimestamp=2021-04-14T12:38:30.812664Z Entering 2021-04-14T12:38:30.813Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f244de2a-1a09-45b3-95d3-17defaf52c22 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:38:30.812582Z InvocationID=4b099191-4eae-4fa6-bd82-58f9d78f154d LogTimestamp=2021-04-14T12:38:30.812664Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:38:30.814Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:38:30.813Z InvocationID=279c4873-4367-475a-a805-153465bce6ce LogTimestamp=2021-04-14T12:38:30.814749Z ResponseDesc=OK Exiting. 2021-04-14T12:38:30.815Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:38:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17be6991-ac1f-4784-aaec-c848c50d3b9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17be6991-ac1f-4784-aaec-c848c50d3b9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@263c0f55 2021-04-14T12:38:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17be6991-ac1f-4784-aaec-c848c50d3b9c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17be6991-ac1f-4784-aaec-c848c50d3b9c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f44f510d-c936-4410-a1d8-5a97d38ed946 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f44f510d-c936-4410-a1d8-5a97d38ed946 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f36caf0 2021-04-14T12:38:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f44f510d-c936-4410-a1d8-5a97d38ed946 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:35.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f44f510d-c936-4410-a1d8-5a97d38ed946 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:36.247Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6334326b-e726-413f-99f7-2c6023c10f5f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:38:36.247809Z InvocationID=836875b5-f0fd-4891-8373-90e527e49700 LogTimestamp=2021-04-14T12:38:36.247856Z Entering 2021-04-14T12:38:36.248Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6334326b-e726-413f-99f7-2c6023c10f5f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:38:36.247809Z InvocationID=836875b5-f0fd-4891-8373-90e527e49700 LogTimestamp=2021-04-14T12:38:36.247856Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:38:36.249Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:38:36.248Z InvocationID=4b720ed5-37d7-4049-b642-611a8edcb6df LogTimestamp=2021-04-14T12:38:36.249050Z ResponseDesc=OK Exiting. 2021-04-14T12:38:36.249Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:38:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6b0511-215b-489d-8f21-f7463ecdfe37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6b0511-215b-489d-8f21-f7463ecdfe37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74633ae0 2021-04-14T12:38:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6b0511-215b-489d-8f21-f7463ecdfe37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:39.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc6b0511-215b-489d-8f21-f7463ecdfe37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:41.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c9cee1-02b3-4d07-a3a8-da07742768c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:41.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c9cee1-02b3-4d07-a3a8-da07742768c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47cfe2bb 2021-04-14T12:38:41.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c9cee1-02b3-4d07-a3a8-da07742768c1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:41.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89c9cee1-02b3-4d07-a3a8-da07742768c1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:45.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4a908d-8178-4cb0-9ecb-830bd3563ec5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:45.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4a908d-8178-4cb0-9ecb-830bd3563ec5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14f0bb0 2021-04-14T12:38:45.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4a908d-8178-4cb0-9ecb-830bd3563ec5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:45.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb4a908d-8178-4cb0-9ecb-830bd3563ec5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:38:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:38:48.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e4f6dcd-7347-45da-8e29-6002cd774c48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:48.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e4f6dcd-7347-45da-8e29-6002cd774c48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68473023 2021-04-14T12:38:48.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e4f6dcd-7347-45da-8e29-6002cd774c48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:48.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e4f6dcd-7347-45da-8e29-6002cd774c48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08b04ea-d87f-4214-81bc-3251d25f7e16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08b04ea-d87f-4214-81bc-3251d25f7e16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51ea3f1 2021-04-14T12:38:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08b04ea-d87f-4214-81bc-3251d25f7e16 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e08b04ea-d87f-4214-81bc-3251d25f7e16 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7900062-527a-4131-a0d0-d9883ce3260d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7900062-527a-4131-a0d0-d9883ce3260d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3dfc43d3 2021-04-14T12:38:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7900062-527a-4131-a0d0-d9883ce3260d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7900062-527a-4131-a0d0-d9883ce3260d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e481cb6-82a9-4ba7-aefe-8fc6793a3a6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e481cb6-82a9-4ba7-aefe-8fc6793a3a6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4417dd57 2021-04-14T12:38:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e481cb6-82a9-4ba7-aefe-8fc6793a3a6d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e481cb6-82a9-4ba7-aefe-8fc6793a3a6d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:38:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c18163-bd6a-4991-8690-fab7b535950c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:38:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c18163-bd6a-4991-8690-fab7b535950c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15002bde 2021-04-14T12:38:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c18163-bd6a-4991-8690-fab7b535950c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:38:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53c18163-bd6a-4991-8690-fab7b535950c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c8a24b-2857-4766-b6ff-ae68fee02704 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c8a24b-2857-4766-b6ff-ae68fee02704 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65f103a4 2021-04-14T12:39:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c8a24b-2857-4766-b6ff-ae68fee02704 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:02.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2c8a24b-2857-4766-b6ff-ae68fee02704 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:39:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:39:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:39:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:39:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:39:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:39:06.239Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=31d87400-c8f7-4657-adc7-771a6002c717 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:06.238881Z InvocationID=a7304d79-ea90-4348-b4fe-e7a47b7a03d8 LogTimestamp=2021-04-14T12:39:06.238982Z Entering 2021-04-14T12:39:06.239Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=31d87400-c8f7-4657-adc7-771a6002c717 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:06.238881Z InvocationID=a7304d79-ea90-4348-b4fe-e7a47b7a03d8 LogTimestamp=2021-04-14T12:39:06.238982Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:39:06.241Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:39:06.239Z InvocationID=13b4e2d3-a221-4335-b739-64a2eff1205e LogTimestamp=2021-04-14T12:39:06.241384Z ResponseDesc=OK Exiting. 2021-04-14T12:39:06.241Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:39:06.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a81244-769b-45a8-99b8-6262a9b4c526 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:06.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a81244-769b-45a8-99b8-6262a9b4c526 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3acc2612 2021-04-14T12:39:06.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a81244-769b-45a8-99b8-6262a9b4c526 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1a81244-769b-45a8-99b8-6262a9b4c526 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b8d631-6a93-4f2e-9894-949f90c46c58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b8d631-6a93-4f2e-9894-949f90c46c58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@404bb979 2021-04-14T12:39:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b8d631-6a93-4f2e-9894-949f90c46c58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:08.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89b8d631-6a93-4f2e-9894-949f90c46c58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:10.113Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e10cbe90-89f8-4984-afea-4a5f6d595e30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:10.112880Z InvocationID=5c64298a-ff7e-401e-9da1-5a71251efda4 LogTimestamp=2021-04-14T12:39:10.112912Z Entering 2021-04-14T12:39:10.113Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e10cbe90-89f8-4984-afea-4a5f6d595e30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:10.112880Z InvocationID=5c64298a-ff7e-401e-9da1-5a71251efda4 LogTimestamp=2021-04-14T12:39:10.112912Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:39:10.114Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:39:10.113Z InvocationID=288fce89-0c76-4239-800b-cb2491f0d238 LogTimestamp=2021-04-14T12:39:10.114184Z ResponseDesc=OK Exiting. 2021-04-14T12:39:10.114Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:39:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=649063b8-016f-4fc2-94f8-60080516c54f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=649063b8-016f-4fc2-94f8-60080516c54f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54013475 2021-04-14T12:39:12.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=649063b8-016f-4fc2-94f8-60080516c54f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:12.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=649063b8-016f-4fc2-94f8-60080516c54f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:14.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9b13911-ce5b-49a8-9eef-58d3aebb3e0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:14.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9b13911-ce5b-49a8-9eef-58d3aebb3e0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3980f172 2021-04-14T12:39:14.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9b13911-ce5b-49a8-9eef-58d3aebb3e0f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:14.724Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9b13911-ce5b-49a8-9eef-58d3aebb3e0f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:16.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53848751-606c-42ea-9b96-19682f4e0951 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53848751-606c-42ea-9b96-19682f4e0951 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6227bce6 2021-04-14T12:39:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53848751-606c-42ea-9b96-19682f4e0951 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53848751-606c-42ea-9b96-19682f4e0951 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:20.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee87b2e-feb0-43ea-a4d4-ef11b1f07f4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:20.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee87b2e-feb0-43ea-a4d4-ef11b1f07f4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fba41aa 2021-04-14T12:39:20.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee87b2e-feb0-43ea-a4d4-ef11b1f07f4b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:20.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ee87b2e-feb0-43ea-a4d4-ef11b1f07f4b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:24.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e7a835-79e6-4db9-9b97-9d7b203d3e7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:24.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e7a835-79e6-4db9-9b97-9d7b203d3e7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@224570b4 2021-04-14T12:39:24.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e7a835-79e6-4db9-9b97-9d7b203d3e7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:24.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e7a835-79e6-4db9-9b97-9d7b203d3e7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:27.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90187aa2-cd73-4ddd-a9ed-1079381fa070 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:27.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90187aa2-cd73-4ddd-a9ed-1079381fa070 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c701eef 2021-04-14T12:39:27.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90187aa2-cd73-4ddd-a9ed-1079381fa070 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:27.314Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=90187aa2-cd73-4ddd-a9ed-1079381fa070 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ad4f83-f08a-4ba0-adae-4b1c40c7ccb0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ad4f83-f08a-4ba0-adae-4b1c40c7ccb0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43ef510b 2021-04-14T12:39:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ad4f83-f08a-4ba0-adae-4b1c40c7ccb0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:30.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46ad4f83-f08a-4ba0-adae-4b1c40c7ccb0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67b05918-c1f1-4567-8fbd-6344f315b784 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67b05918-c1f1-4567-8fbd-6344f315b784 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ef5ffcd 2021-04-14T12:39:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67b05918-c1f1-4567-8fbd-6344f315b784 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67b05918-c1f1-4567-8fbd-6344f315b784 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:35.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98d068f-f636-491b-b7a2-96dd41449b69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:35.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98d068f-f636-491b-b7a2-96dd41449b69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@673cf277 2021-04-14T12:39:35.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98d068f-f636-491b-b7a2-96dd41449b69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:35.716Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c98d068f-f636-491b-b7a2-96dd41449b69 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:36.230Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=14a6dc9d-3a02-48be-a843-28695fac1322 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:36.230677Z InvocationID=51ccaa71-daaf-4bca-b998-b01baba84799 LogTimestamp=2021-04-14T12:39:36.230725Z Entering 2021-04-14T12:39:36.231Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=14a6dc9d-3a02-48be-a843-28695fac1322 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:36.230677Z InvocationID=51ccaa71-daaf-4bca-b998-b01baba84799 LogTimestamp=2021-04-14T12:39:36.230725Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:39:36.232Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:39:36.231Z InvocationID=f2f4cf15-f967-4173-97dc-2aac6b8638a2 LogTimestamp=2021-04-14T12:39:36.232160Z ResponseDesc=OK Exiting. 2021-04-14T12:39:36.232Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:39:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4df6f1b-8631-4a6b-a8b8-5836c51772e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4df6f1b-8631-4a6b-a8b8-5836c51772e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b270f19 2021-04-14T12:39:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4df6f1b-8631-4a6b-a8b8-5836c51772e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4df6f1b-8631-4a6b-a8b8-5836c51772e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e051a1-41d8-4495-83fe-742a34f670a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e051a1-41d8-4495-83fe-742a34f670a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42796e7f 2021-04-14T12:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e051a1-41d8-4495-83fe-742a34f670a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9e051a1-41d8-4495-83fe-742a34f670a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:44.743Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29ac8624-a67f-45f5-9e1f-8bee31115d6f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:44.744Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29ac8624-a67f-45f5-9e1f-8bee31115d6f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@333fa6a 2021-04-14T12:39:44.744Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29ac8624-a67f-45f5-9e1f-8bee31115d6f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:44.744Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=29ac8624-a67f-45f5-9e1f-8bee31115d6f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:39:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:39:48.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdb3936c-07c7-495b-9cd8-060051983408 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:48.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdb3936c-07c7-495b-9cd8-060051983408 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39c1f31 2021-04-14T12:39:48.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdb3936c-07c7-495b-9cd8-060051983408 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:48.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdb3936c-07c7-495b-9cd8-060051983408 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:48.235Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=451ca651-0b1e-4cac-840b-e88ae87790e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:48.235066Z InvocationID=5c1d26e5-f0b7-42d0-903c-6554ab4f77fe LogTimestamp=2021-04-14T12:39:48.235173Z Entering 2021-04-14T12:39:48.235Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=451ca651-0b1e-4cac-840b-e88ae87790e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:39:48.235066Z InvocationID=5c1d26e5-f0b7-42d0-903c-6554ab4f77fe LogTimestamp=2021-04-14T12:39:48.235173Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:39:48.237Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:39:48.235Z InvocationID=0ce6cf33-0a8a-4319-a4ec-2c9cfb1d50ca LogTimestamp=2021-04-14T12:39:48.237826Z ResponseDesc=OK Exiting. 2021-04-14T12:39:48.238Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:39:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58e1f670-ad7f-4ece-b899-cd52eb8ca399 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58e1f670-ad7f-4ece-b899-cd52eb8ca399 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4080879c 2021-04-14T12:39:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58e1f670-ad7f-4ece-b899-cd52eb8ca399 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58e1f670-ad7f-4ece-b899-cd52eb8ca399 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:53.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3550c9a5-dba1-40d3-b4f7-52cae1a47e52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:53.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3550c9a5-dba1-40d3-b4f7-52cae1a47e52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49031365 2021-04-14T12:39:53.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3550c9a5-dba1-40d3-b4f7-52cae1a47e52 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:53.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3550c9a5-dba1-40d3-b4f7-52cae1a47e52 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d77b989-55fb-4865-aa19-dc55da66db60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d77b989-55fb-4865-aa19-dc55da66db60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@557f4085 2021-04-14T12:39:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d77b989-55fb-4865-aa19-dc55da66db60 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d77b989-55fb-4865-aa19-dc55da66db60 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:39:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=716d7c7a-018c-48d1-ba2d-2dcd39d5643a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:39:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=716d7c7a-018c-48d1-ba2d-2dcd39d5643a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36f9b88c 2021-04-14T12:39:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=716d7c7a-018c-48d1-ba2d-2dcd39d5643a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:39:59.525Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=716d7c7a-018c-48d1-ba2d-2dcd39d5643a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=519da0be-f626-4d57-87ad-f3ab7b208574 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=519da0be-f626-4d57-87ad-f3ab7b208574 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@720175a8 2021-04-14T12:40:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=519da0be-f626-4d57-87ad-f3ab7b208574 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=519da0be-f626-4d57-87ad-f3ab7b208574 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:40:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:40:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:40:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:40:05.680Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling \t--> HTTP/1.1 404 Not Found 2021-04-14T12:40:05.680Z [TopicPollingThread-1] WARN c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Topic not found: /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:40:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87b28e0-5067-427f-ab8f-a40d3b0a777c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87b28e0-5067-427f-ab8f-a40d3b0a777c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2348c8b6 2021-04-14T12:40:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87b28e0-5067-427f-ab8f-a40d3b0a777c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b87b28e0-5067-427f-ab8f-a40d3b0a777c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:06.339Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7534f192-d184-4aef-8525-4d69d80fd2db InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:40:06.339283Z InvocationID=e7547625-30f9-46ce-aa53-2293d5e4eb96 LogTimestamp=2021-04-14T12:40:06.339363Z Entering 2021-04-14T12:40:06.339Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7534f192-d184-4aef-8525-4d69d80fd2db InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:40:06.339283Z InvocationID=e7547625-30f9-46ce-aa53-2293d5e4eb96 LogTimestamp=2021-04-14T12:40:06.339363Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:40:06.341Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:40:06.339Z InvocationID=1a404009-9473-4b62-a05f-69dbfdd5b9f5 LogTimestamp=2021-04-14T12:40:06.341618Z ResponseDesc=OK Exiting. 2021-04-14T12:40:06.341Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:40:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe7dc765-418c-4150-a8d4-05ee5c5526da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe7dc765-418c-4150-a8d4-05ee5c5526da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c9cdf32 2021-04-14T12:40:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe7dc765-418c-4150-a8d4-05ee5c5526da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe7dc765-418c-4150-a8d4-05ee5c5526da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b35e2e-d1c5-490c-b5ef-c661bd001b1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b35e2e-d1c5-490c-b5ef-c661bd001b1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77da2bf5 2021-04-14T12:40:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b35e2e-d1c5-490c-b5ef-c661bd001b1a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:12.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85b35e2e-d1c5-490c-b5ef-c661bd001b1a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:14.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45aaf7fe-03d4-4737-b187-26de96ab9cc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:14.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45aaf7fe-03d4-4737-b187-26de96ab9cc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e8fac93 2021-04-14T12:40:14.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45aaf7fe-03d4-4737-b187-26de96ab9cc8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:14.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45aaf7fe-03d4-4737-b187-26de96ab9cc8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ac4d281-1f20-4db4-a97e-393f6c20e061 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ac4d281-1f20-4db4-a97e-393f6c20e061 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6be7d88c 2021-04-14T12:40:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ac4d281-1f20-4db4-a97e-393f6c20e061 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ac4d281-1f20-4db4-a97e-393f6c20e061 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=093a6c8e-8ce2-4cd7-a9e8-5f37842e5e48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=093a6c8e-8ce2-4cd7-a9e8-5f37842e5e48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e8ff8d 2021-04-14T12:40:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=093a6c8e-8ce2-4cd7-a9e8-5f37842e5e48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:20.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=093a6c8e-8ce2-4cd7-a9e8-5f37842e5e48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f9d8925-55fb-44d1-bde8-458698cc6ec2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f9d8925-55fb-44d1-bde8-458698cc6ec2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@274bf9c6 2021-04-14T12:40:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f9d8925-55fb-44d1-bde8-458698cc6ec2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:24.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f9d8925-55fb-44d1-bde8-458698cc6ec2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:26.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc8a8723-4d24-4598-8b5d-80ce215c5243 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:26.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc8a8723-4d24-4598-8b5d-80ce215c5243 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54d32288 2021-04-14T12:40:26.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc8a8723-4d24-4598-8b5d-80ce215c5243 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:26.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc8a8723-4d24-4598-8b5d-80ce215c5243 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:29.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d64d14b-adc2-448e-8ef9-eed4d5abefb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:29.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d64d14b-adc2-448e-8ef9-eed4d5abefb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a5b326 2021-04-14T12:40:29.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d64d14b-adc2-448e-8ef9-eed4d5abefb7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:29.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d64d14b-adc2-448e-8ef9-eed4d5abefb7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d07caf-1103-498a-9e7b-2fe0f63d7d0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d07caf-1103-498a-9e7b-2fe0f63d7d0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47f73008 2021-04-14T12:40:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d07caf-1103-498a-9e7b-2fe0f63d7d0e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74d07caf-1103-498a-9e7b-2fe0f63d7d0e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node044l4enkz46mcuo6ok3spaul0294 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0awenx30i704z8iyjmehaw6sd313 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01sc0j4rjnfz2h2h5bmgeuevlq290 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01o5480n78d7c91wjtine2b05r1316 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09g7dttgofjffvalw8u1m4iek320 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01wuocpqimy5wb30epaxo356qe317 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dsknmomwi4pf12tch1r939xb8307 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01w0sftcw5mhux9tpz332fn6tr319 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01a62jalui5na81k7hp1plblaks293 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0qrdcwgujuc38wn2t9ye2amf5300 2021-04-14T12:40:34.617Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01wfoh55wsmodd1bu3dmaa96xl6303 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s90947d0njukzqqsejqfgndv311 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05mkc6qficvcp1a1ngd1ojo2dv289 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01twngetflohrmn8989k4zimqx314 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0gwljf8lpui6k1id56x4gh3x69295 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hcopitklo63f1pd2vu4hve7ae299 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ay4fjnmd6d101ipsg01kb1o4l288 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02800aa94etlija3jg8kt48v5318 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01pyd55y1796yd9s0u6cfnloor298 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0huw6xf283i131ahatkkz3meau291 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01wskk5v76ml7hg9pksgufgx4m304 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01a9ax8ng6621qhp9pjnvr0tyc309 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node058w5g2vxhw8h1iny9wp2z7hzl302 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01avd6nw29u66s16wb0bpbnfag1308 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xo71yehwofnok0ffxrym8q22301 2021-04-14T12:40:34.618Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0v5k2m9p08jns1a12pjyrjhh6h305 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d6n7m4nz54zy1sffssq7tcfjt306 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01no7wegy1v0wx1igzz8da8p5th297 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node011oltculvou3b1x9f0llulmojm322 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04gvkamde5djv75sn2t3u11vm312 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010mdh7pl5i7ds12wcckuczl0e296 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0larbj4rweh8w1o46xtntyob3a315 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d6y93nwc41hrsvra0cohz9xv310 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01os45xbv7zwbzyc3sai0y1p8e321 2021-04-14T12:40:34.619Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0f1ohckbpwg1y8vfbnqwpp261292 2021-04-14T12:40:36.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76bddf97-8a0c-44fb-aeb0-59d98847983f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76bddf97-8a0c-44fb-aeb0-59d98847983f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f0a74f9 2021-04-14T12:40:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76bddf97-8a0c-44fb-aeb0-59d98847983f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76bddf97-8a0c-44fb-aeb0-59d98847983f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:36.239Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0dce59ba-14f5-4b3a-86d6-a2886018cf91 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:40:36.239128Z InvocationID=5bd47164-4495-4b53-a311-4bba4607d294 LogTimestamp=2021-04-14T12:40:36.239188Z Entering 2021-04-14T12:40:36.239Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0dce59ba-14f5-4b3a-86d6-a2886018cf91 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:40:36.239128Z InvocationID=5bd47164-4495-4b53-a311-4bba4607d294 LogTimestamp=2021-04-14T12:40:36.239188Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:40:36.240Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:40:36.239Z InvocationID=2ca126d1-77fb-4fbc-8832-2e05385a746f LogTimestamp=2021-04-14T12:40:36.240578Z ResponseDesc=OK Exiting. 2021-04-14T12:40:36.240Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:40:39.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ca3623d-8bfc-457e-923b-9a6aeb05cda4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:39.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ca3623d-8bfc-457e-923b-9a6aeb05cda4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7200d6f2 2021-04-14T12:40:39.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ca3623d-8bfc-457e-923b-9a6aeb05cda4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:39.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ca3623d-8bfc-457e-923b-9a6aeb05cda4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd02d4b2-1bf7-4a1a-8bf5-69f867b2a12a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd02d4b2-1bf7-4a1a-8bf5-69f867b2a12a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e107717 2021-04-14T12:40:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd02d4b2-1bf7-4a1a-8bf5-69f867b2a12a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd02d4b2-1bf7-4a1a-8bf5-69f867b2a12a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d8e239-f5e5-4ec1-aac6-bb24164c9d52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d8e239-f5e5-4ec1-aac6-bb24164c9d52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20996bad 2021-04-14T12:40:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d8e239-f5e5-4ec1-aac6-bb24164c9d52 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84d8e239-f5e5-4ec1-aac6-bb24164c9d52 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:46.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:40:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:40:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fe5e84-f970-49ac-a0da-74142d698f4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fe5e84-f970-49ac-a0da-74142d698f4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c587efb 2021-04-14T12:40:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fe5e84-f970-49ac-a0da-74142d698f4c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4fe5e84-f970-49ac-a0da-74142d698f4c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beec11af-793b-4104-bad4-67ed3df29454 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beec11af-793b-4104-bad4-67ed3df29454 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@381b86c4 2021-04-14T12:40:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beec11af-793b-4104-bad4-67ed3df29454 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beec11af-793b-4104-bad4-67ed3df29454 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=175aebb5-406c-4c37-bd87-70e0d05b7cfb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=175aebb5-406c-4c37-bd87-70e0d05b7cfb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65eef61f 2021-04-14T12:40:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=175aebb5-406c-4c37-bd87-70e0d05b7cfb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=175aebb5-406c-4c37-bd87-70e0d05b7cfb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:57.235Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8001bf3e-0e93-418a-be2c-b76722de78c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:57.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8001bf3e-0e93-418a-be2c-b76722de78c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ec12d0c 2021-04-14T12:40:57.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8001bf3e-0e93-418a-be2c-b76722de78c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:57.236Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8001bf3e-0e93-418a-be2c-b76722de78c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:40:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28c837a-e9c3-49cc-9a25-54dd476a56cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:40:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28c837a-e9c3-49cc-9a25-54dd476a56cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e12589 2021-04-14T12:40:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28c837a-e9c3-49cc-9a25-54dd476a56cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:40:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28c837a-e9c3-49cc-9a25-54dd476a56cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:02.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd7e68e-78a5-4e1e-98aa-525ea8264d63 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:02.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd7e68e-78a5-4e1e-98aa-525ea8264d63 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65a8bed7 2021-04-14T12:41:02.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd7e68e-78a5-4e1e-98aa-525ea8264d63 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:02.815Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cd7e68e-78a5-4e1e-98aa-525ea8264d63 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:41:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:41:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:41:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:41:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:41:06.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1d5fbb-e009-486d-8afd-98cdc0162746 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:06.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1d5fbb-e009-486d-8afd-98cdc0162746 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7764f273 2021-04-14T12:41:06.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1d5fbb-e009-486d-8afd-98cdc0162746 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:06.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1d5fbb-e009-486d-8afd-98cdc0162746 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:06.255Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=91b9416f-28cd-4361-ab0d-aa61ace8c9b3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:06.254907Z InvocationID=944b7a5d-1f14-4f29-8f60-01f7b2ca4174 LogTimestamp=2021-04-14T12:41:06.255018Z Entering 2021-04-14T12:41:06.255Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=91b9416f-28cd-4361-ab0d-aa61ace8c9b3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:06.254907Z InvocationID=944b7a5d-1f14-4f29-8f60-01f7b2ca4174 LogTimestamp=2021-04-14T12:41:06.255018Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:41:06.257Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:41:06.255Z InvocationID=ba331222-21f2-4a5c-8e09-0719ecbf2e2f LogTimestamp=2021-04-14T12:41:06.257827Z ResponseDesc=OK Exiting. 2021-04-14T12:41:06.258Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:41:08.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12721206-2f8c-459b-a802-e1fd17b03c6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:08.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12721206-2f8c-459b-a802-e1fd17b03c6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70ca18de 2021-04-14T12:41:08.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12721206-2f8c-459b-a802-e1fd17b03c6c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:08.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12721206-2f8c-459b-a802-e1fd17b03c6c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:12.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b328e05d-a84c-490f-b5b2-5ebfcb8814f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b328e05d-a84c-490f-b5b2-5ebfcb8814f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@788fb623 2021-04-14T12:41:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b328e05d-a84c-490f-b5b2-5ebfcb8814f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b328e05d-a84c-490f-b5b2-5ebfcb8814f8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:14.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80aeccb3-cf21-4a44-ba27-eb9fba510569 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:14.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80aeccb3-cf21-4a44-ba27-eb9fba510569 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5871f1e3 2021-04-14T12:41:14.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80aeccb3-cf21-4a44-ba27-eb9fba510569 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:14.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=80aeccb3-cf21-4a44-ba27-eb9fba510569 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d7856f-9aff-40ad-bea6-32bb21bd3d73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d7856f-9aff-40ad-bea6-32bb21bd3d73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8d667f4 2021-04-14T12:41:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d7856f-9aff-40ad-bea6-32bb21bd3d73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d7856f-9aff-40ad-bea6-32bb21bd3d73 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:20.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffa8fe5f-feb9-4a61-8dce-eeaebbcbd64a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:20.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffa8fe5f-feb9-4a61-8dce-eeaebbcbd64a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28fa82d8 2021-04-14T12:41:20.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffa8fe5f-feb9-4a61-8dce-eeaebbcbd64a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:20.569Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffa8fe5f-feb9-4a61-8dce-eeaebbcbd64a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3591d7a-fa8c-44db-ab12-9423227bdecb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3591d7a-fa8c-44db-ab12-9423227bdecb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d41174a 2021-04-14T12:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3591d7a-fa8c-44db-ab12-9423227bdecb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3591d7a-fa8c-44db-ab12-9423227bdecb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:27.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=335bb304-6ef8-43fc-b908-c1a7eefac52a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:27.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=335bb304-6ef8-43fc-b908-c1a7eefac52a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a6815e8 2021-04-14T12:41:27.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=335bb304-6ef8-43fc-b908-c1a7eefac52a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:27.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=335bb304-6ef8-43fc-b908-c1a7eefac52a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac87536-a925-40b6-a1fb-f737327cd5df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac87536-a925-40b6-a1fb-f737327cd5df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@413a3496 2021-04-14T12:41:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac87536-a925-40b6-a1fb-f737327cd5df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:30.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aac87536-a925-40b6-a1fb-f737327cd5df PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96381d2-25ca-4e27-93a9-126730b9805d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96381d2-25ca-4e27-93a9-126730b9805d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d2a822b 2021-04-14T12:41:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96381d2-25ca-4e27-93a9-126730b9805d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a96381d2-25ca-4e27-93a9-126730b9805d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:36.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd89f9d-1a4e-4858-bae8-11c32097cedf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:36.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd89f9d-1a4e-4858-bae8-11c32097cedf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18743983 2021-04-14T12:41:36.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd89f9d-1a4e-4858-bae8-11c32097cedf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:36.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fd89f9d-1a4e-4858-bae8-11c32097cedf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:36.231Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6def1ce1-5a65-4a6d-b0e9-a15c544f5add InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:36.230748Z InvocationID=c5fb6b3c-7b8f-4dbe-8074-8037b29aeaa3 LogTimestamp=2021-04-14T12:41:36.230819Z Entering 2021-04-14T12:41:36.231Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6def1ce1-5a65-4a6d-b0e9-a15c544f5add InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:36.230748Z InvocationID=c5fb6b3c-7b8f-4dbe-8074-8037b29aeaa3 LogTimestamp=2021-04-14T12:41:36.230819Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:41:36.233Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:41:36.231Z InvocationID=fc9b59fe-0fdc-46e5-8659-44f43cc92d1a LogTimestamp=2021-04-14T12:41:36.232963Z ResponseDesc=OK Exiting. 2021-04-14T12:41:36.233Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:41:38.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b425f89-753f-493e-a280-047366412149 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:38.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b425f89-753f-493e-a280-047366412149 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2289b830 2021-04-14T12:41:38.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b425f89-753f-493e-a280-047366412149 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:38.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b425f89-753f-493e-a280-047366412149 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e18501c-c5bd-42a7-bb79-fef52a412841 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e18501c-c5bd-42a7-bb79-fef52a412841 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3207b673 2021-04-14T12:41:41.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e18501c-c5bd-42a7-bb79-fef52a412841 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:41.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2e18501c-c5bd-42a7-bb79-fef52a412841 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:45.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f7716c8-8a6d-4adf-9994-8e0c7ef20bcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:45.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f7716c8-8a6d-4adf-9994-8e0c7ef20bcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b5541c2 2021-04-14T12:41:45.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f7716c8-8a6d-4adf-9994-8e0c7ef20bcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:45.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f7716c8-8a6d-4adf-9994-8e0c7ef20bcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:41:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:41:47.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93af0cdd-390a-4dfd-86cf-46fd1754a4bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:47.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93af0cdd-390a-4dfd-86cf-46fd1754a4bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62d4c30a 2021-04-14T12:41:47.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93af0cdd-390a-4dfd-86cf-46fd1754a4bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:47.890Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93af0cdd-390a-4dfd-86cf-46fd1754a4bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:48.219Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e24434fa-7ecd-4a19-a455-fc60a6d21701 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:48.219636Z InvocationID=740e191d-7f9e-4482-b5a7-03956d18a75f LogTimestamp=2021-04-14T12:41:48.219695Z Entering 2021-04-14T12:41:48.220Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e24434fa-7ecd-4a19-a455-fc60a6d21701 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:48.219636Z InvocationID=740e191d-7f9e-4482-b5a7-03956d18a75f LogTimestamp=2021-04-14T12:41:48.219695Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:41:48.221Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:41:48.220Z InvocationID=09bb506b-9f79-4dad-8492-4d61668f167b LogTimestamp=2021-04-14T12:41:48.221132Z ResponseDesc=OK Exiting. 2021-04-14T12:41:48.221Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:41:51.423Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0e894f8-3dab-486c-858d-9f08da619e84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:51.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0e894f8-3dab-486c-858d-9f08da619e84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d73af58 2021-04-14T12:41:51.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0e894f8-3dab-486c-858d-9f08da619e84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:51.424Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f0e894f8-3dab-486c-858d-9f08da619e84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:54.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79864774-e339-4d54-99c0-44295af52e72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:54.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79864774-e339-4d54-99c0-44295af52e72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24834ab 2021-04-14T12:41:54.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79864774-e339-4d54-99c0-44295af52e72 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:54.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79864774-e339-4d54-99c0-44295af52e72 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:56.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00384756-849e-444d-9447-1b8e98d4baf2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:56.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00384756-849e-444d-9447-1b8e98d4baf2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73622e71 2021-04-14T12:41:56.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00384756-849e-444d-9447-1b8e98d4baf2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:56.939Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00384756-849e-444d-9447-1b8e98d4baf2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:41:59.213Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e6af6834-9564-4a30-a70a-46845c8ffbb4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:59.212763Z InvocationID=6f03aa00-6062-4549-8250-978baec1841e LogTimestamp=2021-04-14T12:41:59.212832Z Entering 2021-04-14T12:41:59.213Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e6af6834-9564-4a30-a70a-46845c8ffbb4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:41:59.212763Z InvocationID=6f03aa00-6062-4549-8250-978baec1841e LogTimestamp=2021-04-14T12:41:59.212832Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:41:59.214Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:41:59.213Z InvocationID=9c6b6785-21c2-47d8-b962-420a909570e9 LogTimestamp=2021-04-14T12:41:59.214559Z ResponseDesc=OK Exiting. 2021-04-14T12:41:59.214Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:41:59.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8971ac19-6ff9-436b-8f00-1787808056cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:41:59.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8971ac19-6ff9-436b-8f00-1787808056cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37ea6f84 2021-04-14T12:41:59.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8971ac19-6ff9-436b-8f00-1787808056cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:41:59.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8971ac19-6ff9-436b-8f00-1787808056cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0ddff42-d036-4f53-9811-174b43190cee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0ddff42-d036-4f53-9811-174b43190cee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27731f4e 2021-04-14T12:42:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0ddff42-d036-4f53-9811-174b43190cee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0ddff42-d036-4f53-9811-174b43190cee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:42:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:42:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:42:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:42:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:42:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:42:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef2b458-b628-4d9e-82c4-50a9709e8f48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef2b458-b628-4d9e-82c4-50a9709e8f48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@645d9a67 2021-04-14T12:42:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef2b458-b628-4d9e-82c4-50a9709e8f48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:06.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef2b458-b628-4d9e-82c4-50a9709e8f48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:06.332Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d856acd0-858b-48be-8d40-9bafe1e3bac5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:42:06.332Z InvocationID=6a82feed-c959-46f8-9249-db2e3ca3c8ba LogTimestamp=2021-04-14T12:42:06.332033Z Entering 2021-04-14T12:42:06.332Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d856acd0-858b-48be-8d40-9bafe1e3bac5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:42:06.332Z InvocationID=6a82feed-c959-46f8-9249-db2e3ca3c8ba LogTimestamp=2021-04-14T12:42:06.332033Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:42:06.333Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:42:06.332Z InvocationID=da156a08-06f1-43f6-9511-4c48be382365 LogTimestamp=2021-04-14T12:42:06.333276Z ResponseDesc=OK Exiting. 2021-04-14T12:42:06.333Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:42:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c749f8f-65eb-41eb-a039-a11f09fc60bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c749f8f-65eb-41eb-a039-a11f09fc60bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ae313b 2021-04-14T12:42:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c749f8f-65eb-41eb-a039-a11f09fc60bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:08.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c749f8f-65eb-41eb-a039-a11f09fc60bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed2b2f83-5717-49ab-aa7e-d373a77e0129 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed2b2f83-5717-49ab-aa7e-d373a77e0129 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62dce825 2021-04-14T12:42:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed2b2f83-5717-49ab-aa7e-d373a77e0129 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:11.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed2b2f83-5717-49ab-aa7e-d373a77e0129 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e917826-5dc7-44ff-9157-b01f38c54ba1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e917826-5dc7-44ff-9157-b01f38c54ba1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dea125f 2021-04-14T12:42:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e917826-5dc7-44ff-9157-b01f38c54ba1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e917826-5dc7-44ff-9157-b01f38c54ba1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:16.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d204c169-4626-41bc-ab36-6dd3ec2620f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d204c169-4626-41bc-ab36-6dd3ec2620f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@556c3527 2021-04-14T12:42:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d204c169-4626-41bc-ab36-6dd3ec2620f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:18.093Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d204c169-4626-41bc-ab36-6dd3ec2620f9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bab31d9-ad80-473f-848b-6899b0103cd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bab31d9-ad80-473f-848b-6899b0103cd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@223cf158 2021-04-14T12:42:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bab31d9-ad80-473f-848b-6899b0103cd0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bab31d9-ad80-473f-848b-6899b0103cd0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc9c392-880a-4a07-8cdb-6d81f28457bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc9c392-880a-4a07-8cdb-6d81f28457bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27a4a8fa 2021-04-14T12:42:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc9c392-880a-4a07-8cdb-6d81f28457bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:24.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bc9c392-880a-4a07-8cdb-6d81f28457bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:26.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df75489-40ed-474f-b0d8-7711c222745e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:26.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df75489-40ed-474f-b0d8-7711c222745e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ad13ebb 2021-04-14T12:42:26.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df75489-40ed-474f-b0d8-7711c222745e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:26.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6df75489-40ed-474f-b0d8-7711c222745e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:29.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e89cbc-d126-4dfe-88fa-24f0e346ba60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:29.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e89cbc-d126-4dfe-88fa-24f0e346ba60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e20f3cb 2021-04-14T12:42:29.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e89cbc-d126-4dfe-88fa-24f0e346ba60 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:29.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e89cbc-d126-4dfe-88fa-24f0e346ba60 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ce0a70-8d52-4e5d-bfd6-85a4c09c815d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ce0a70-8d52-4e5d-bfd6-85a4c09c815d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b537766 2021-04-14T12:42:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ce0a70-8d52-4e5d-bfd6-85a4c09c815d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:33.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=86ce0a70-8d52-4e5d-bfd6-85a4c09c815d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:35.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b6067bb-df81-4336-9236-2d74d582fd90 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:35.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b6067bb-df81-4336-9236-2d74d582fd90 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59b2f78e 2021-04-14T12:42:35.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b6067bb-df81-4336-9236-2d74d582fd90 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:35.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b6067bb-df81-4336-9236-2d74d582fd90 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:36.236Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3205e2bd-e28e-4c2d-ba2d-02f62d0b0936 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:42:36.236460Z InvocationID=45d98977-1f78-44b5-bd55-82ae0855be36 LogTimestamp=2021-04-14T12:42:36.236518Z Entering 2021-04-14T12:42:36.236Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3205e2bd-e28e-4c2d-ba2d-02f62d0b0936 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:42:36.236460Z InvocationID=45d98977-1f78-44b5-bd55-82ae0855be36 LogTimestamp=2021-04-14T12:42:36.236518Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:42:36.238Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:42:36.236Z InvocationID=0b6e4e34-4dc6-4dfb-82a4-9e7419985cf5 LogTimestamp=2021-04-14T12:42:36.238571Z ResponseDesc=OK Exiting. 2021-04-14T12:42:36.238Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:42:39.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d1e755-49f0-4d70-93e6-7044da488fbe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:39.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d1e755-49f0-4d70-93e6-7044da488fbe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a352ee5 2021-04-14T12:42:39.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d1e755-49f0-4d70-93e6-7044da488fbe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:39.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59d1e755-49f0-4d70-93e6-7044da488fbe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24cca551-3292-4d33-9899-a82c609aae54 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24cca551-3292-4d33-9899-a82c609aae54 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@639234c3 2021-04-14T12:42:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24cca551-3292-4d33-9899-a82c609aae54 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:41.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24cca551-3292-4d33-9899-a82c609aae54 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:45.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36e2633c-05e4-409c-ba3c-6fb8909ccf11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:45.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36e2633c-05e4-409c-ba3c-6fb8909ccf11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@233a9790 2021-04-14T12:42:45.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36e2633c-05e4-409c-ba3c-6fb8909ccf11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:45.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36e2633c-05e4-409c-ba3c-6fb8909ccf11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:42:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:42:47.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ec33efb-652b-4fdc-91be-acd7b20b2304 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:47.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ec33efb-652b-4fdc-91be-acd7b20b2304 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d7a1afe 2021-04-14T12:42:47.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ec33efb-652b-4fdc-91be-acd7b20b2304 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:47.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ec33efb-652b-4fdc-91be-acd7b20b2304 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:51.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da347aa-0596-48fe-9d99-42aedfcadfe0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:51.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da347aa-0596-48fe-9d99-42aedfcadfe0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3eeb53b2 2021-04-14T12:42:51.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da347aa-0596-48fe-9d99-42aedfcadfe0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:51.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1da347aa-0596-48fe-9d99-42aedfcadfe0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:53.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee5eb15-627c-4296-9d2d-d65217bf0bea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:53.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee5eb15-627c-4296-9d2d-d65217bf0bea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c2d5c80 2021-04-14T12:42:53.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee5eb15-627c-4296-9d2d-d65217bf0bea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:53.957Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee5eb15-627c-4296-9d2d-d65217bf0bea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de97654d-99fa-48cb-98ba-df2ea4b46b2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de97654d-99fa-48cb-98ba-df2ea4b46b2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b5cc482 2021-04-14T12:42:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de97654d-99fa-48cb-98ba-df2ea4b46b2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de97654d-99fa-48cb-98ba-df2ea4b46b2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:42:59.603Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16c434a-fb4d-49de-8dfd-6f665933d3f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:42:59.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16c434a-fb4d-49de-8dfd-6f665933d3f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64c94fd 2021-04-14T12:42:59.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16c434a-fb4d-49de-8dfd-6f665933d3f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:42:59.604Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16c434a-fb4d-49de-8dfd-6f665933d3f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47454a5d-4f11-46ba-bf7f-d775e7fd0108 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47454a5d-4f11-46ba-bf7f-d775e7fd0108 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62de2145 2021-04-14T12:43:02.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47454a5d-4f11-46ba-bf7f-d775e7fd0108 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:02.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47454a5d-4f11-46ba-bf7f-d775e7fd0108 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:43:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:43:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:43:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:43:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:43:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:43:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06452ef2-10e5-49d8-9587-ff94035487e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06452ef2-10e5-49d8-9587-ff94035487e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4431a8c2 2021-04-14T12:43:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06452ef2-10e5-49d8-9587-ff94035487e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:06.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=06452ef2-10e5-49d8-9587-ff94035487e6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:06.242Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=aa169f25-24ed-4436-8293-008edfce39e0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:06.242307Z InvocationID=60e332f5-46e7-42c5-9970-6059cdb32f03 LogTimestamp=2021-04-14T12:43:06.242381Z Entering 2021-04-14T12:43:06.243Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=aa169f25-24ed-4436-8293-008edfce39e0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:06.242307Z InvocationID=60e332f5-46e7-42c5-9970-6059cdb32f03 LogTimestamp=2021-04-14T12:43:06.242381Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:43:06.244Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:43:06.243Z InvocationID=97c98d7a-d01a-4b89-bc33-7a4bd07856d0 LogTimestamp=2021-04-14T12:43:06.244769Z ResponseDesc=OK Exiting. 2021-04-14T12:43:06.245Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:43:09.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec326a5-b01b-4c5f-ba12-f9643818c0c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:09.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec326a5-b01b-4c5f-ba12-f9643818c0c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19141c12 2021-04-14T12:43:09.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec326a5-b01b-4c5f-ba12-f9643818c0c1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:09.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ec326a5-b01b-4c5f-ba12-f9643818c0c1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:12.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45d3cd36-51bf-4bab-afa5-9e996345a821 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45d3cd36-51bf-4bab-afa5-9e996345a821 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b9d98b1 2021-04-14T12:43:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45d3cd36-51bf-4bab-afa5-9e996345a821 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45d3cd36-51bf-4bab-afa5-9e996345a821 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe252f9-043c-480b-903b-74c790022f62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:14.781Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe252f9-043c-480b-903b-74c790022f62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@685a5a8e 2021-04-14T12:43:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe252f9-043c-480b-903b-74c790022f62 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bbe252f9-043c-480b-903b-74c790022f62 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:16.207Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:16.211Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:17.086Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b18115b7-9701-4055-bd21-207d79b448c9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:17.086527Z InvocationID=31350a8e-fbe9-4fda-9910-e0e3c0754778 LogTimestamp=2021-04-14T12:43:17.086587Z Entering 2021-04-14T12:43:17.086Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b18115b7-9701-4055-bd21-207d79b448c9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:17.086527Z InvocationID=31350a8e-fbe9-4fda-9910-e0e3c0754778 LogTimestamp=2021-04-14T12:43:17.086587Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:43:17.088Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:43:17.087Z InvocationID=65cd3bc3-7faa-4d07-bc5e-0622e753c247 LogTimestamp=2021-04-14T12:43:17.088081Z ResponseDesc=OK Exiting. 2021-04-14T12:43:17.088Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:43:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe5804c-3495-4ae2-b24b-d4aa4bb2eabd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe5804c-3495-4ae2-b24b-d4aa4bb2eabd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@216488ff 2021-04-14T12:43:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe5804c-3495-4ae2-b24b-d4aa4bb2eabd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:17.991Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe5804c-3495-4ae2-b24b-d4aa4bb2eabd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf0769-b493-4843-89c0-27c43be4fc2e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf0769-b493-4843-89c0-27c43be4fc2e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18a9e44d 2021-04-14T12:43:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf0769-b493-4843-89c0-27c43be4fc2e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdf0769-b493-4843-89c0-27c43be4fc2e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:21.418Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f54de747-4815-4da8-834b-1fd0a98bb357 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:21.418018Z InvocationID=2d5af0f8-bc7e-40c3-b122-b79a99e44acf LogTimestamp=2021-04-14T12:43:21.418055Z Entering 2021-04-14T12:43:21.418Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f54de747-4815-4da8-834b-1fd0a98bb357 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:21.418018Z InvocationID=2d5af0f8-bc7e-40c3-b122-b79a99e44acf LogTimestamp=2021-04-14T12:43:21.418055Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:43:21.419Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:43:21.418Z InvocationID=c9977e26-2a62-4279-a76b-51622ac41977 LogTimestamp=2021-04-14T12:43:21.419426Z ResponseDesc=OK Exiting. 2021-04-14T12:43:21.419Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:43:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8467a6-dfa3-4278-ab1b-814cef8c4e1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8467a6-dfa3-4278-ab1b-814cef8c4e1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fe6bff9 2021-04-14T12:43:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8467a6-dfa3-4278-ab1b-814cef8c4e1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d8467a6-dfa3-4278-ab1b-814cef8c4e1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:26.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f21ff00-6836-4a06-af5e-a6a1a64170c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:26.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f21ff00-6836-4a06-af5e-a6a1a64170c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35520aa1 2021-04-14T12:43:26.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f21ff00-6836-4a06-af5e-a6a1a64170c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:26.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f21ff00-6836-4a06-af5e-a6a1a64170c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4374cf2c-978a-43ee-ac2e-90819097e3d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4374cf2c-978a-43ee-ac2e-90819097e3d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30f44f84 2021-04-14T12:43:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4374cf2c-978a-43ee-ac2e-90819097e3d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4374cf2c-978a-43ee-ac2e-90819097e3d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4a13eee-8655-4cc7-aef2-6ca67e0569a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4a13eee-8655-4cc7-aef2-6ca67e0569a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67a84e5b 2021-04-14T12:43:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4a13eee-8655-4cc7-aef2-6ca67e0569a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4a13eee-8655-4cc7-aef2-6ca67e0569a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:35.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c692dd6-bfef-41aa-852b-89bb9ff2d790 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:35.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c692dd6-bfef-41aa-852b-89bb9ff2d790 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d0b3c20 2021-04-14T12:43:35.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c692dd6-bfef-41aa-852b-89bb9ff2d790 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:35.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c692dd6-bfef-41aa-852b-89bb9ff2d790 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:36.232Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=48e0cb1b-744a-4a6d-bbe8-148754092202 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:36.232381Z InvocationID=9f0a35a3-8982-456e-aa77-4a86e6e714a8 LogTimestamp=2021-04-14T12:43:36.232414Z Entering 2021-04-14T12:43:36.232Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=48e0cb1b-744a-4a6d-bbe8-148754092202 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:36.232381Z InvocationID=9f0a35a3-8982-456e-aa77-4a86e6e714a8 LogTimestamp=2021-04-14T12:43:36.232414Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:43:36.233Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:43:36.232Z InvocationID=d219f183-5d68-4130-bb5f-24a8596534c6 LogTimestamp=2021-04-14T12:43:36.233447Z ResponseDesc=OK Exiting. 2021-04-14T12:43:36.233Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:43:38.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c2ff76c-165d-43b7-abd9-be1a2c899783 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:38.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c2ff76c-165d-43b7-abd9-be1a2c899783 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78293222 2021-04-14T12:43:38.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c2ff76c-165d-43b7-abd9-be1a2c899783 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:38.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c2ff76c-165d-43b7-abd9-be1a2c899783 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:41.629Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed83bc6a-cdaa-486b-ae26-d646a28896f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:41.629Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed83bc6a-cdaa-486b-ae26-d646a28896f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a33dacc 2021-04-14T12:43:41.629Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed83bc6a-cdaa-486b-ae26-d646a28896f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:41.629Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed83bc6a-cdaa-486b-ae26-d646a28896f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc39d312-1556-4e04-8871-ab5bba90f518 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc39d312-1556-4e04-8871-ab5bba90f518 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f4c8b47 2021-04-14T12:43:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc39d312-1556-4e04-8871-ab5bba90f518 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:45.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc39d312-1556-4e04-8871-ab5bba90f518 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:43:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:43:48.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5214cdc2-c4c6-4f39-87ab-cf55d7204ee0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:48.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5214cdc2-c4c6-4f39-87ab-cf55d7204ee0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ba254b2 2021-04-14T12:43:48.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5214cdc2-c4c6-4f39-87ab-cf55d7204ee0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:48.002Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5214cdc2-c4c6-4f39-87ab-cf55d7204ee0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:48.253Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=87e50253-725f-4977-9c08-62e8422d227e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:48.253019Z InvocationID=cef22e7e-d821-407c-bd32-6896c6dd7a90 LogTimestamp=2021-04-14T12:43:48.253107Z Entering 2021-04-14T12:43:48.253Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=87e50253-725f-4977-9c08-62e8422d227e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:43:48.253019Z InvocationID=cef22e7e-d821-407c-bd32-6896c6dd7a90 LogTimestamp=2021-04-14T12:43:48.253107Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:43:48.255Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:43:48.253Z InvocationID=c049eec6-7898-4397-8b79-3101813bd8be LogTimestamp=2021-04-14T12:43:48.255605Z ResponseDesc=OK Exiting. 2021-04-14T12:43:48.256Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:43:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b778c61-7417-401f-a272-5201a9e2410c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b778c61-7417-401f-a272-5201a9e2410c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a2bc7c6 2021-04-14T12:43:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b778c61-7417-401f-a272-5201a9e2410c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b778c61-7417-401f-a272-5201a9e2410c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:53.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c736f8d4-e11a-449f-8a3f-914b10fac300 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:53.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c736f8d4-e11a-449f-8a3f-914b10fac300 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@eba97f5 2021-04-14T12:43:53.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c736f8d4-e11a-449f-8a3f-914b10fac300 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:53.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c736f8d4-e11a-449f-8a3f-914b10fac300 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26984320-ee34-4a73-86d0-e5221727789f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26984320-ee34-4a73-86d0-e5221727789f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@258733d6 2021-04-14T12:43:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26984320-ee34-4a73-86d0-e5221727789f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:56.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26984320-ee34-4a73-86d0-e5221727789f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:43:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06bbbd6-398b-46bb-8ddf-ed097c735e60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:43:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06bbbd6-398b-46bb-8ddf-ed097c735e60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cd9f410 2021-04-14T12:43:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06bbbd6-398b-46bb-8ddf-ed097c735e60 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:43:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06bbbd6-398b-46bb-8ddf-ed097c735e60 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2225b67e-c459-458b-af9e-0b2be629b027 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2225b67e-c459-458b-af9e-0b2be629b027 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58e819ba 2021-04-14T12:44:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2225b67e-c459-458b-af9e-0b2be629b027 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:03.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2225b67e-c459-458b-af9e-0b2be629b027 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:44:04.352Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:44:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:44:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:44:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:44:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:44:06.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bafcbccd-3990-4901-8cfe-0527e60e8d42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:06.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bafcbccd-3990-4901-8cfe-0527e60e8d42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@237286d 2021-04-14T12:44:06.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bafcbccd-3990-4901-8cfe-0527e60e8d42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:06.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bafcbccd-3990-4901-8cfe-0527e60e8d42 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:06.243Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f931cff1-66fb-4a63-a508-27b96f33e6c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:44:06.242925Z InvocationID=a2a0d1bb-e137-4a5b-a23c-0f64001f4b86 LogTimestamp=2021-04-14T12:44:06.242994Z Entering 2021-04-14T12:44:06.243Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f931cff1-66fb-4a63-a508-27b96f33e6c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:44:06.242925Z InvocationID=a2a0d1bb-e137-4a5b-a23c-0f64001f4b86 LogTimestamp=2021-04-14T12:44:06.242994Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:44:06.245Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:44:06.243Z InvocationID=8f6c6f4c-8022-4517-ac08-5578dcc9c5c8 LogTimestamp=2021-04-14T12:44:06.245162Z ResponseDesc=OK Exiting. 2021-04-14T12:44:06.245Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:44:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d033386c-4913-42a3-b7bb-158049e22822 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:09.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d033386c-4913-42a3-b7bb-158049e22822 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e32a27e 2021-04-14T12:44:09.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d033386c-4913-42a3-b7bb-158049e22822 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:09.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d033386c-4913-42a3-b7bb-158049e22822 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:11.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f69b114-b62a-4575-bb4c-49d36497e252 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:11.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f69b114-b62a-4575-bb4c-49d36497e252 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2df8bcdc 2021-04-14T12:44:11.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f69b114-b62a-4575-bb4c-49d36497e252 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:11.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f69b114-b62a-4575-bb4c-49d36497e252 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea30611-5306-4be4-a054-0f1010ea4d8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea30611-5306-4be4-a054-0f1010ea4d8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35c55510 2021-04-14T12:44:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea30611-5306-4be4-a054-0f1010ea4d8e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea30611-5306-4be4-a054-0f1010ea4d8e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:16.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:16.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c681c7da-6cea-4cad-934c-30b4ad2c3e73 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c681c7da-6cea-4cad-934c-30b4ad2c3e73 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e8a6785 2021-04-14T12:44:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c681c7da-6cea-4cad-934c-30b4ad2c3e73 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:18.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c681c7da-6cea-4cad-934c-30b4ad2c3e73 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7637b89a-8902-4a76-9859-275409048ef8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7637b89a-8902-4a76-9859-275409048ef8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a01578 2021-04-14T12:44:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7637b89a-8902-4a76-9859-275409048ef8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7637b89a-8902-4a76-9859-275409048ef8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:24.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=525d7a1d-c3ea-4ab7-9754-b94cd8c794f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:24.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=525d7a1d-c3ea-4ab7-9754-b94cd8c794f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d56574c 2021-04-14T12:44:24.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=525d7a1d-c3ea-4ab7-9754-b94cd8c794f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:24.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=525d7a1d-c3ea-4ab7-9754-b94cd8c794f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:27.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21cb14b8-71d7-4535-b137-08c38dbb68c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:27.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21cb14b8-71d7-4535-b137-08c38dbb68c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7224f223 2021-04-14T12:44:27.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21cb14b8-71d7-4535-b137-08c38dbb68c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:27.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21cb14b8-71d7-4535-b137-08c38dbb68c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09cf89c1-583c-45cf-afce-a914922b518f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09cf89c1-583c-45cf-afce-a914922b518f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fcf15ad 2021-04-14T12:44:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09cf89c1-583c-45cf-afce-a914922b518f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09cf89c1-583c-45cf-afce-a914922b518f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:33.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a457f932-72ed-470f-b081-8676bf293065 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:33.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a457f932-72ed-470f-b081-8676bf293065 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ac1def9 2021-04-14T12:44:33.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a457f932-72ed-470f-b081-8676bf293065 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:33.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a457f932-72ed-470f-b081-8676bf293065 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=392bfdd4-c150-4c94-9684-b8a540c836e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=392bfdd4-c150-4c94-9684-b8a540c836e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@757210da 2021-04-14T12:44:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=392bfdd4-c150-4c94-9684-b8a540c836e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:35.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=392bfdd4-c150-4c94-9684-b8a540c836e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:36.239Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=46981573-f51a-4e92-8f1a-5247cd470605 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:44:36.239344Z InvocationID=15647b37-cb48-4c5d-b5e1-5d67aadc346e LogTimestamp=2021-04-14T12:44:36.239475Z Entering 2021-04-14T12:44:36.240Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=46981573-f51a-4e92-8f1a-5247cd470605 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:44:36.239344Z InvocationID=15647b37-cb48-4c5d-b5e1-5d67aadc346e LogTimestamp=2021-04-14T12:44:36.239475Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:44:36.242Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:44:36.240Z InvocationID=ff313468-72d3-4962-ac8b-4bf9e7ed565f LogTimestamp=2021-04-14T12:44:36.242471Z ResponseDesc=OK Exiting. 2021-04-14T12:44:36.242Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:44:38.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ae57d4-68a0-4d01-a4a1-868379b36f68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:38.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ae57d4-68a0-4d01-a4a1-868379b36f68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@201251bd 2021-04-14T12:44:38.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ae57d4-68a0-4d01-a4a1-868379b36f68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:38.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8ae57d4-68a0-4d01-a4a1-868379b36f68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:41.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b6fc07-08d3-4502-af14-7c5c117cbe80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:41.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b6fc07-08d3-4502-af14-7c5c117cbe80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77a74a6f 2021-04-14T12:44:41.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b6fc07-08d3-4502-af14-7c5c117cbe80 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:41.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53b6fc07-08d3-4502-af14-7c5c117cbe80 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:44.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8f24a0-ea71-4cc4-96dc-bc98714edb03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:44.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8f24a0-ea71-4cc4-96dc-bc98714edb03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53357474 2021-04-14T12:44:44.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8f24a0-ea71-4cc4-96dc-bc98714edb03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:44.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab8f24a0-ea71-4cc4-96dc-bc98714edb03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:44:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:44:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0aa2cd7-3db4-46e5-937c-6afda0497a08 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0aa2cd7-3db4-46e5-937c-6afda0497a08 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36a44a08 2021-04-14T12:44:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0aa2cd7-3db4-46e5-937c-6afda0497a08 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0aa2cd7-3db4-46e5-937c-6afda0497a08 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:51.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bf29c1c-5dbc-4816-a7f8-e1132b093681 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:51.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bf29c1c-5dbc-4816-a7f8-e1132b093681 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4896ad8 2021-04-14T12:44:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bf29c1c-5dbc-4816-a7f8-e1132b093681 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bf29c1c-5dbc-4816-a7f8-e1132b093681 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:54.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d8f73d-26b2-4c72-9fce-7512cb9cbd35 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:54.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d8f73d-26b2-4c72-9fce-7512cb9cbd35 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49b0bc14 2021-04-14T12:44:54.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d8f73d-26b2-4c72-9fce-7512cb9cbd35 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:54.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37d8f73d-26b2-4c72-9fce-7512cb9cbd35 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:56.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d16255-8d18-461b-9e32-ab54dca5f161 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:56.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d16255-8d18-461b-9e32-ab54dca5f161 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31def782 2021-04-14T12:44:56.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d16255-8d18-461b-9e32-ab54dca5f161 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:56.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75d16255-8d18-461b-9e32-ab54dca5f161 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:44:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72069b02-eca6-4077-9bff-5f52313cdaf6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:44:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72069b02-eca6-4077-9bff-5f52313cdaf6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@253e1fbb 2021-04-14T12:44:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72069b02-eca6-4077-9bff-5f52313cdaf6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:44:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72069b02-eca6-4077-9bff-5f52313cdaf6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:03.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c0d505-95d4-4d8e-ae7a-7e00e462fb5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:03.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c0d505-95d4-4d8e-ae7a-7e00e462fb5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a2e7e6e 2021-04-14T12:45:03.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c0d505-95d4-4d8e-ae7a-7e00e462fb5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:03.234Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3c0d505-95d4-4d8e-ae7a-7e00e462fb5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:45:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:45:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:45:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:45:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:45:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:45:06.225Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=569cc1cc-b85e-41db-a3b9-c77cacd8d9a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:06.225182Z InvocationID=d1c5e87e-001f-473f-94f5-c61bba934813 LogTimestamp=2021-04-14T12:45:06.225245Z Entering 2021-04-14T12:45:06.225Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=569cc1cc-b85e-41db-a3b9-c77cacd8d9a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:06.225182Z InvocationID=d1c5e87e-001f-473f-94f5-c61bba934813 LogTimestamp=2021-04-14T12:45:06.225245Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:45:06.227Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:45:06.225Z InvocationID=b127cd7b-a90c-48df-8726-d8f6cc5d92a1 LogTimestamp=2021-04-14T12:45:06.227603Z ResponseDesc=OK Exiting. 2021-04-14T12:45:06.227Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:45:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b7627-98df-44d6-aca2-68f20b99d684 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b7627-98df-44d6-aca2-68f20b99d684 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26b23f23 2021-04-14T12:45:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b7627-98df-44d6-aca2-68f20b99d684 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0a8b7627-98df-44d6-aca2-68f20b99d684 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:09.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21f4559d-1a2c-430c-8259-6f65945c7374 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21f4559d-1a2c-430c-8259-6f65945c7374 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6096ae90 2021-04-14T12:45:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21f4559d-1a2c-430c-8259-6f65945c7374 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:09.190Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21f4559d-1a2c-430c-8259-6f65945c7374 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d0192d-73e8-45a9-8b3d-f4c13ca07410 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d0192d-73e8-45a9-8b3d-f4c13ca07410 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3500b6fe 2021-04-14T12:45:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d0192d-73e8-45a9-8b3d-f4c13ca07410 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:12.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5d0192d-73e8-45a9-8b3d-f4c13ca07410 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:14.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66694d4c-a7af-4a13-9250-94eeabf2537e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:14.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66694d4c-a7af-4a13-9250-94eeabf2537e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cc4733e 2021-04-14T12:45:14.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66694d4c-a7af-4a13-9250-94eeabf2537e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:14.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66694d4c-a7af-4a13-9250-94eeabf2537e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:15.754Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7751738d-2eb3-4d6a-8261-315052b7794a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:15.753630Z InvocationID=caefbf44-66e1-4aa7-9ed9-70e9e64f58fc LogTimestamp=2021-04-14T12:45:15.753762Z Entering 2021-04-14T12:45:15.754Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7751738d-2eb3-4d6a-8261-315052b7794a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:15.753630Z InvocationID=caefbf44-66e1-4aa7-9ed9-70e9e64f58fc LogTimestamp=2021-04-14T12:45:15.753762Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:45:15.756Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:45:15.754Z InvocationID=94afc0f7-00d4-4a55-8eff-537c3146c104 LogTimestamp=2021-04-14T12:45:15.756846Z ResponseDesc=OK Exiting. 2021-04-14T12:45:15.757Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:45:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2166d24-cfdb-4c7d-b8a9-31d2b95a9b37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2166d24-cfdb-4c7d-b8a9-31d2b95a9b37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bb80aa2 2021-04-14T12:45:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2166d24-cfdb-4c7d-b8a9-31d2b95a9b37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:17.992Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2166d24-cfdb-4c7d-b8a9-31d2b95a9b37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:20.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=062aee77-3679-4606-9862-008ff472f190 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:20.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=062aee77-3679-4606-9862-008ff472f190 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e0fd56b 2021-04-14T12:45:20.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=062aee77-3679-4606-9862-008ff472f190 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:20.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=062aee77-3679-4606-9862-008ff472f190 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ffa2ae-69f0-4b70-8f52-6a8378092000 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ffa2ae-69f0-4b70-8f52-6a8378092000 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e083d12 2021-04-14T12:45:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ffa2ae-69f0-4b70-8f52-6a8378092000 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:24.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ffa2ae-69f0-4b70-8f52-6a8378092000 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0566841-c52f-4c18-ab25-bbaa9913b978 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0566841-c52f-4c18-ab25-bbaa9913b978 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71daec6e 2021-04-14T12:45:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0566841-c52f-4c18-ab25-bbaa9913b978 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0566841-c52f-4c18-ab25-bbaa9913b978 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5017acfa-4f63-4bf3-a8c8-5faf18472d42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5017acfa-4f63-4bf3-a8c8-5faf18472d42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a6c05ed 2021-04-14T12:45:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5017acfa-4f63-4bf3-a8c8-5faf18472d42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5017acfa-4f63-4bf3-a8c8-5faf18472d42 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3feedc45-ab04-4eb3-9680-9cc1f490de35 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3feedc45-ab04-4eb3-9680-9cc1f490de35 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a783946 2021-04-14T12:45:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3feedc45-ab04-4eb3-9680-9cc1f490de35 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3feedc45-ab04-4eb3-9680-9cc1f490de35 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:36.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30336eb-6a6a-486c-a7b5-7f4e6363d852 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:36.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30336eb-6a6a-486c-a7b5-7f4e6363d852 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25a777b6 2021-04-14T12:45:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30336eb-6a6a-486c-a7b5-7f4e6363d852 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:36.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30336eb-6a6a-486c-a7b5-7f4e6363d852 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:36.241Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b4422e1a-f668-40d6-a0a1-efbe9ad29575 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:36.240814Z InvocationID=918c9c8b-ead2-4499-8eb8-0acc37f82374 LogTimestamp=2021-04-14T12:45:36.240906Z Entering 2021-04-14T12:45:36.241Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b4422e1a-f668-40d6-a0a1-efbe9ad29575 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:36.240814Z InvocationID=918c9c8b-ead2-4499-8eb8-0acc37f82374 LogTimestamp=2021-04-14T12:45:36.240906Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:45:36.243Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:45:36.241Z InvocationID=8f2c227a-7219-4f9f-a963-f97425b66889 LogTimestamp=2021-04-14T12:45:36.243244Z ResponseDesc=OK Exiting. 2021-04-14T12:45:36.243Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:45:38.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc414a7c-dd4c-4c25-938d-59571bf6f769 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:38.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc414a7c-dd4c-4c25-938d-59571bf6f769 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33856f0 2021-04-14T12:45:38.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc414a7c-dd4c-4c25-938d-59571bf6f769 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:38.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc414a7c-dd4c-4c25-938d-59571bf6f769 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f17e1b4d-5e25-42a6-9e22-6432e587f642 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f17e1b4d-5e25-42a6-9e22-6432e587f642 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49b17817 2021-04-14T12:45:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f17e1b4d-5e25-42a6-9e22-6432e587f642 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f17e1b4d-5e25-42a6-9e22-6432e587f642 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:44.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=606fb05e-f17a-4924-b0bf-42d2e201ad6d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:44.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=606fb05e-f17a-4924-b0bf-42d2e201ad6d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12d8da6e 2021-04-14T12:45:44.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=606fb05e-f17a-4924-b0bf-42d2e201ad6d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:44.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=606fb05e-f17a-4924-b0bf-42d2e201ad6d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:45:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:45:47.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7872cb6f-4a4b-4b79-b3fb-1013dc8bc37d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:47.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7872cb6f-4a4b-4b79-b3fb-1013dc8bc37d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cdc0544 2021-04-14T12:45:47.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7872cb6f-4a4b-4b79-b3fb-1013dc8bc37d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:47.999Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7872cb6f-4a4b-4b79-b3fb-1013dc8bc37d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:48.225Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3331b3de-3ea4-499a-b2cd-1294e19aa580 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:48.225356Z InvocationID=ea3dd273-1786-4265-bd58-580b83dc5cb4 LogTimestamp=2021-04-14T12:45:48.225435Z Entering 2021-04-14T12:45:48.225Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3331b3de-3ea4-499a-b2cd-1294e19aa580 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:45:48.225356Z InvocationID=ea3dd273-1786-4265-bd58-580b83dc5cb4 LogTimestamp=2021-04-14T12:45:48.225435Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:45:48.227Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:45:48.226Z InvocationID=4d85b67d-7581-4ba0-883e-e47d189dd254 LogTimestamp=2021-04-14T12:45:48.227545Z ResponseDesc=OK Exiting. 2021-04-14T12:45:48.227Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:45:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1943c819-7c1e-4eb6-a7b0-3b3b4b970319 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1943c819-7c1e-4eb6-a7b0-3b3b4b970319 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d925df9 2021-04-14T12:45:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1943c819-7c1e-4eb6-a7b0-3b3b4b970319 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:51.320Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1943c819-7c1e-4eb6-a7b0-3b3b4b970319 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:53.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b826d1e-36a1-4803-a369-5875e386c2ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:53.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b826d1e-36a1-4803-a369-5875e386c2ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fa1f59c 2021-04-14T12:45:53.759Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b826d1e-36a1-4803-a369-5875e386c2ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:53.760Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b826d1e-36a1-4803-a369-5875e386c2ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:56.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9163c1-f19a-494c-823c-c91db8591953 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:56.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9163c1-f19a-494c-823c-c91db8591953 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b7e45ac 2021-04-14T12:45:56.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9163c1-f19a-494c-823c-c91db8591953 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:56.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f9163c1-f19a-494c-823c-c91db8591953 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:45:59.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230d9027-77fa-4991-8be4-cb3e7fd964f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:45:59.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230d9027-77fa-4991-8be4-cb3e7fd964f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37649da2 2021-04-14T12:45:59.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230d9027-77fa-4991-8be4-cb3e7fd964f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:45:59.521Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=230d9027-77fa-4991-8be4-cb3e7fd964f8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9fdbef2-3fea-4b59-bc71-8702a781d60a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9fdbef2-3fea-4b59-bc71-8702a781d60a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68466322 2021-04-14T12:46:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9fdbef2-3fea-4b59-bc71-8702a781d60a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9fdbef2-3fea-4b59-bc71-8702a781d60a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:46:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:46:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:46:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:46:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:46:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:46:06.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ffd9801-56e9-479f-910f-4575d96af896 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:06.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ffd9801-56e9-479f-910f-4575d96af896 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68cb66a3 2021-04-14T12:46:06.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ffd9801-56e9-479f-910f-4575d96af896 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:06.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ffd9801-56e9-479f-910f-4575d96af896 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:06.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=99ad8e72-f4ae-41ef-8f8f-8e52bc6d7642 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:46:06.235638Z InvocationID=0c9f482f-8635-4118-8598-19351305d2d2 LogTimestamp=2021-04-14T12:46:06.235701Z Entering 2021-04-14T12:46:06.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=99ad8e72-f4ae-41ef-8f8f-8e52bc6d7642 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:46:06.235638Z InvocationID=0c9f482f-8635-4118-8598-19351305d2d2 LogTimestamp=2021-04-14T12:46:06.235701Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:46:06.236Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:46:06.236Z InvocationID=d10abb0c-4421-45de-9d8c-94ebca5e821a LogTimestamp=2021-04-14T12:46:06.236762Z ResponseDesc=OK Exiting. 2021-04-14T12:46:06.237Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:46:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc2777cb-94e3-4f26-a03f-2fcde7d7e3e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc2777cb-94e3-4f26-a03f-2fcde7d7e3e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41311d33 2021-04-14T12:46:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc2777cb-94e3-4f26-a03f-2fcde7d7e3e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc2777cb-94e3-4f26-a03f-2fcde7d7e3e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd4e043-52b2-4549-8cee-f6d1524ce093 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd4e043-52b2-4549-8cee-f6d1524ce093 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@522b013a 2021-04-14T12:46:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd4e043-52b2-4549-8cee-f6d1524ce093 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cd4e043-52b2-4549-8cee-f6d1524ce093 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:14.692Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc076d92-3d99-4536-a61e-5cafe1e5ed21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc076d92-3d99-4536-a61e-5cafe1e5ed21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9af272e 2021-04-14T12:46:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc076d92-3d99-4536-a61e-5cafe1e5ed21 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc076d92-3d99-4536-a61e-5cafe1e5ed21 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:18.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3a1fea7-691a-4f6b-8f22-5bbca2d9bb13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:18.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3a1fea7-691a-4f6b-8f22-5bbca2d9bb13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a62b6c6 2021-04-14T12:46:18.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3a1fea7-691a-4f6b-8f22-5bbca2d9bb13 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:18.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3a1fea7-691a-4f6b-8f22-5bbca2d9bb13 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=632b8168-e146-4f16-aed7-889fad50f6a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=632b8168-e146-4f16-aed7-889fad50f6a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73f3fc3c 2021-04-14T12:46:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=632b8168-e146-4f16-aed7-889fad50f6a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=632b8168-e146-4f16-aed7-889fad50f6a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:24.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=767e2e23-7471-49aa-aa13-9c02ce1d3bde PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:24.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=767e2e23-7471-49aa-aa13-9c02ce1d3bde PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79db11a9 2021-04-14T12:46:24.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=767e2e23-7471-49aa-aa13-9c02ce1d3bde PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:24.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=767e2e23-7471-49aa-aa13-9c02ce1d3bde PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:27.200Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d99174c-67a3-4bb6-b537-a1e75881cf24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:27.200Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d99174c-67a3-4bb6-b537-a1e75881cf24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9bdcfeb 2021-04-14T12:46:27.200Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d99174c-67a3-4bb6-b537-a1e75881cf24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:27.200Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d99174c-67a3-4bb6-b537-a1e75881cf24 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d32e144-c030-4741-bc56-2c7343dfdee4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d32e144-c030-4741-bc56-2c7343dfdee4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26c69c9c 2021-04-14T12:46:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d32e144-c030-4741-bc56-2c7343dfdee4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d32e144-c030-4741-bc56-2c7343dfdee4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43759617-ad6e-41ec-aff8-f8a86a25cd1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43759617-ad6e-41ec-aff8-f8a86a25cd1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ab88664 2021-04-14T12:46:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43759617-ad6e-41ec-aff8-f8a86a25cd1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43759617-ad6e-41ec-aff8-f8a86a25cd1d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:35.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f6e78e-f6c4-4db5-968f-d7f247e712b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:35.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f6e78e-f6c4-4db5-968f-d7f247e712b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bcf90c3 2021-04-14T12:46:35.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f6e78e-f6c4-4db5-968f-d7f247e712b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:35.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=83f6e78e-f6c4-4db5-968f-d7f247e712b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:36.237Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ffa15d69-5f55-40c3-b408-b99418bcc1a1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:46:36.236448Z InvocationID=05cc6300-14cf-418d-8426-faf55e76493d LogTimestamp=2021-04-14T12:46:36.236568Z Entering 2021-04-14T12:46:36.237Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ffa15d69-5f55-40c3-b408-b99418bcc1a1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:46:36.236448Z InvocationID=05cc6300-14cf-418d-8426-faf55e76493d LogTimestamp=2021-04-14T12:46:36.236568Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:46:36.240Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:46:36.237Z InvocationID=fde03b6d-9163-494c-a2ed-19f55d7f1651 LogTimestamp=2021-04-14T12:46:36.240006Z ResponseDesc=OK Exiting. 2021-04-14T12:46:36.240Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:46:39.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=479a42f9-42aa-4509-a21b-b9805959a812 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:39.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=479a42f9-42aa-4509-a21b-b9805959a812 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cead8c6 2021-04-14T12:46:39.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=479a42f9-42aa-4509-a21b-b9805959a812 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:39.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=479a42f9-42aa-4509-a21b-b9805959a812 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b805723a-9f93-4481-9496-3dd72a4c690a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b805723a-9f93-4481-9496-3dd72a4c690a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e5a87bb 2021-04-14T12:46:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b805723a-9f93-4481-9496-3dd72a4c690a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:41.534Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b805723a-9f93-4481-9496-3dd72a4c690a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d442ec82-39ac-441c-956d-9e6ba7807d8e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d442ec82-39ac-441c-956d-9e6ba7807d8e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10dfb9b2 2021-04-14T12:46:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d442ec82-39ac-441c-956d-9e6ba7807d8e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:45.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d442ec82-39ac-441c-956d-9e6ba7807d8e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:46:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:46:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb598ac0-2da2-492b-bef8-7f8300bb2a2a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb598ac0-2da2-492b-bef8-7f8300bb2a2a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7016ae2 2021-04-14T12:46:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb598ac0-2da2-492b-bef8-7f8300bb2a2a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb598ac0-2da2-492b-bef8-7f8300bb2a2a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:51.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a24df80e-c059-4b67-b3b6-3068f0fffe4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:51.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a24df80e-c059-4b67-b3b6-3068f0fffe4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d77ae2c 2021-04-14T12:46:51.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a24df80e-c059-4b67-b3b6-3068f0fffe4a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:51.418Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a24df80e-c059-4b67-b3b6-3068f0fffe4a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:53.669Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c264357e-c4a4-47f1-bf15-87e1e93059ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:53.669Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c264357e-c4a4-47f1-bf15-87e1e93059ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@175a9d66 2021-04-14T12:46:53.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c264357e-c4a4-47f1-bf15-87e1e93059ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:53.670Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c264357e-c4a4-47f1-bf15-87e1e93059ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:56.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a9c4de9-eaa9-4e67-86bd-ebf6687c52bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:56.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a9c4de9-eaa9-4e67-86bd-ebf6687c52bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a25a416 2021-04-14T12:46:56.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a9c4de9-eaa9-4e67-86bd-ebf6687c52bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:56.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a9c4de9-eaa9-4e67-86bd-ebf6687c52bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:46:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8237eb19-cfef-4a94-9055-5992af9189ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:46:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8237eb19-cfef-4a94-9055-5992af9189ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@767f87ca 2021-04-14T12:46:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8237eb19-cfef-4a94-9055-5992af9189ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:46:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8237eb19-cfef-4a94-9055-5992af9189ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:03.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7434f887-9871-45bf-a738-ff523eda1a1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:03.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7434f887-9871-45bf-a738-ff523eda1a1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@169941e7 2021-04-14T12:47:03.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7434f887-9871-45bf-a738-ff523eda1a1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:03.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7434f887-9871-45bf-a738-ff523eda1a1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:47:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:47:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:47:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:47:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:47:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:47:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d01c7aa0-11f6-4517-9ff8-fd3670feaa63 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d01c7aa0-11f6-4517-9ff8-fd3670feaa63 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55eb4fff 2021-04-14T12:47:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d01c7aa0-11f6-4517-9ff8-fd3670feaa63 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d01c7aa0-11f6-4517-9ff8-fd3670feaa63 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:06.233Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=718d9070-1a04-4ed1-90ea-4969bf63d479 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:06.233055Z InvocationID=07e1b4c2-5378-46a2-be9b-33fa37e243f3 LogTimestamp=2021-04-14T12:47:06.233213Z Entering 2021-04-14T12:47:06.234Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=718d9070-1a04-4ed1-90ea-4969bf63d479 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:06.233055Z InvocationID=07e1b4c2-5378-46a2-be9b-33fa37e243f3 LogTimestamp=2021-04-14T12:47:06.233213Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:47:06.237Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:47:06.234Z InvocationID=3ca83558-1db4-4d2d-9f4a-af9ca59fee3a LogTimestamp=2021-04-14T12:47:06.236969Z ResponseDesc=OK Exiting. 2021-04-14T12:47:06.237Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:47:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ddaf211-900c-4af0-ae2a-f58d3af188d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ddaf211-900c-4af0-ae2a-f58d3af188d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b95440 2021-04-14T12:47:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ddaf211-900c-4af0-ae2a-f58d3af188d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ddaf211-900c-4af0-ae2a-f58d3af188d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ac5ca3-47da-42d4-bebd-3d1569152c3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ac5ca3-47da-42d4-bebd-3d1569152c3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@872c20a 2021-04-14T12:47:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ac5ca3-47da-42d4-bebd-3d1569152c3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18ac5ca3-47da-42d4-bebd-3d1569152c3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:14.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab81f425-b7f7-44c4-9940-d8b30e3f9c8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:14.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab81f425-b7f7-44c4-9940-d8b30e3f9c8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54b83c9a 2021-04-14T12:47:14.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab81f425-b7f7-44c4-9940-d8b30e3f9c8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:14.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab81f425-b7f7-44c4-9940-d8b30e3f9c8f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:16.340Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5c499f86-debc-4c23-b962-d0fb0dd29e72 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:16.340461Z InvocationID=52d98bcd-8676-4f1e-95a6-991edb77b337 LogTimestamp=2021-04-14T12:47:16.340498Z Entering 2021-04-14T12:47:16.340Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5c499f86-debc-4c23-b962-d0fb0dd29e72 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:16.340461Z InvocationID=52d98bcd-8676-4f1e-95a6-991edb77b337 LogTimestamp=2021-04-14T12:47:16.340498Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:47:16.341Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:47:16.340Z InvocationID=d5028588-1d85-4c8f-a738-39043617bd86 LogTimestamp=2021-04-14T12:47:16.341597Z ResponseDesc=OK Exiting. 2021-04-14T12:47:16.341Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:47:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aba99d6-4246-48f1-a058-3fbc40f07998 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aba99d6-4246-48f1-a058-3fbc40f07998 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b230545 2021-04-14T12:47:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aba99d6-4246-48f1-a058-3fbc40f07998 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2aba99d6-4246-48f1-a058-3fbc40f07998 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d924108b-3e14-4eb7-8b72-895a934a55b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d924108b-3e14-4eb7-8b72-895a934a55b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13f05135 2021-04-14T12:47:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d924108b-3e14-4eb7-8b72-895a934a55b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d924108b-3e14-4eb7-8b72-895a934a55b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:24.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30a239c-c630-4427-9452-93459c6adba6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:24.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30a239c-c630-4427-9452-93459c6adba6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d8ca3d3 2021-04-14T12:47:24.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30a239c-c630-4427-9452-93459c6adba6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:24.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b30a239c-c630-4427-9452-93459c6adba6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de5d5b81-59be-4913-8db1-4c73923ca23d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de5d5b81-59be-4913-8db1-4c73923ca23d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18c51214 2021-04-14T12:47:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de5d5b81-59be-4913-8db1-4c73923ca23d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de5d5b81-59be-4913-8db1-4c73923ca23d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:30.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96d7ce8e-ad33-44e8-8b08-4a8159599fcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:30.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96d7ce8e-ad33-44e8-8b08-4a8159599fcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b0f3564 2021-04-14T12:47:30.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96d7ce8e-ad33-44e8-8b08-4a8159599fcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:30.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96d7ce8e-ad33-44e8-8b08-4a8159599fcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf27875f-442a-49de-8003-750c07a78139 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf27875f-442a-49de-8003-750c07a78139 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae7aec9 2021-04-14T12:47:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf27875f-442a-49de-8003-750c07a78139 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf27875f-442a-49de-8003-750c07a78139 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=773f93af-08de-42b0-99c2-0233d232dfda PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=773f93af-08de-42b0-99c2-0233d232dfda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@221d0e7d 2021-04-14T12:47:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=773f93af-08de-42b0-99c2-0233d232dfda PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:36.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=773f93af-08de-42b0-99c2-0233d232dfda PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:36.221Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=af4f9c85-4a91-4869-a585-9921d6bdeadd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:36.221115Z InvocationID=b0dd7345-da5c-4132-afcf-039f17f5011d LogTimestamp=2021-04-14T12:47:36.221164Z Entering 2021-04-14T12:47:36.221Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=af4f9c85-4a91-4869-a585-9921d6bdeadd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:36.221115Z InvocationID=b0dd7345-da5c-4132-afcf-039f17f5011d LogTimestamp=2021-04-14T12:47:36.221164Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:47:36.222Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:47:36.221Z InvocationID=5e099c7d-84d2-426e-922b-20abb6e8427b LogTimestamp=2021-04-14T12:47:36.222306Z ResponseDesc=OK Exiting. 2021-04-14T12:47:36.222Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:47:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7ae090-2e80-4613-99d7-60c22036a9bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7ae090-2e80-4613-99d7-60c22036a9bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1278ed98 2021-04-14T12:47:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7ae090-2e80-4613-99d7-60c22036a9bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b7ae090-2e80-4613-99d7-60c22036a9bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe7e52e-fb2d-4063-8023-e366ea202cbd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe7e52e-fb2d-4063-8023-e366ea202cbd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@307e5ea6 2021-04-14T12:47:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe7e52e-fb2d-4063-8023-e366ea202cbd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebe7e52e-fb2d-4063-8023-e366ea202cbd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cfa5b7-eccb-4da5-8c55-a6c0902c5405 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cfa5b7-eccb-4da5-8c55-a6c0902c5405 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47983f86 2021-04-14T12:47:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cfa5b7-eccb-4da5-8c55-a6c0902c5405 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8cfa5b7-eccb-4da5-8c55-a6c0902c5405 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:47:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:47:47.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad34cbc4-b05e-46ab-8013-08ca74d4e15e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:47.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad34cbc4-b05e-46ab-8013-08ca74d4e15e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d3cafee 2021-04-14T12:47:47.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad34cbc4-b05e-46ab-8013-08ca74d4e15e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:47.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad34cbc4-b05e-46ab-8013-08ca74d4e15e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:48.238Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f0833734-9255-4e11-9fae-d3992edc9ff7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:48.238312Z InvocationID=78a688df-8132-4743-bf4a-8f4b1baa4620 LogTimestamp=2021-04-14T12:47:48.238458Z Entering 2021-04-14T12:47:48.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f0833734-9255-4e11-9fae-d3992edc9ff7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:47:48.238312Z InvocationID=78a688df-8132-4743-bf4a-8f4b1baa4620 LogTimestamp=2021-04-14T12:47:48.238458Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:47:48.240Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:47:48.239Z InvocationID=99f8be68-876a-49a0-ae13-31282bed5c6b LogTimestamp=2021-04-14T12:47:48.240856Z ResponseDesc=OK Exiting. 2021-04-14T12:47:48.241Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:47:51.318Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ef3636a-f2b2-42b0-80df-1090ce59efc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:51.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ef3636a-f2b2-42b0-80df-1090ce59efc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58fd97fc 2021-04-14T12:47:51.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ef3636a-f2b2-42b0-80df-1090ce59efc0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:51.319Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ef3636a-f2b2-42b0-80df-1090ce59efc0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b60e49fe-0b16-4a39-a340-b6d88b5dffc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b60e49fe-0b16-4a39-a340-b6d88b5dffc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a34692b 2021-04-14T12:47:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b60e49fe-0b16-4a39-a340-b6d88b5dffc0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b60e49fe-0b16-4a39-a340-b6d88b5dffc0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78fd4990-0439-4022-b81c-5df07f6efc32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78fd4990-0439-4022-b81c-5df07f6efc32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c5611e4 2021-04-14T12:47:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78fd4990-0439-4022-b81c-5df07f6efc32 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=78fd4990-0439-4022-b81c-5df07f6efc32 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:47:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7c6e811-27d7-487d-a4ac-c1771a48ce28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:47:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7c6e811-27d7-487d-a4ac-c1771a48ce28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74fd9e5f 2021-04-14T12:47:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7c6e811-27d7-487d-a4ac-c1771a48ce28 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:47:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7c6e811-27d7-487d-a4ac-c1771a48ce28 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:02.644Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31b6285-125e-40b9-8fef-1310fd5d2c3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:02.644Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31b6285-125e-40b9-8fef-1310fd5d2c3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@408ba54b 2021-04-14T12:48:02.644Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31b6285-125e-40b9-8fef-1310fd5d2c3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:02.644Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c31b6285-125e-40b9-8fef-1310fd5d2c3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:48:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:48:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:48:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:48:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:48:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:48:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3255e2ea-dda6-438d-95e0-914b45dcaadf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3255e2ea-dda6-438d-95e0-914b45dcaadf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79cfe140 2021-04-14T12:48:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3255e2ea-dda6-438d-95e0-914b45dcaadf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:06.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3255e2ea-dda6-438d-95e0-914b45dcaadf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:06.231Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f2f4fcd6-69cc-4444-9192-2840bee719e9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:48:06.230009Z InvocationID=c6af1bd6-fc2b-437a-b824-1704342a0c86 LogTimestamp=2021-04-14T12:48:06.230106Z Entering 2021-04-14T12:48:06.231Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f2f4fcd6-69cc-4444-9192-2840bee719e9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:48:06.230009Z InvocationID=c6af1bd6-fc2b-437a-b824-1704342a0c86 LogTimestamp=2021-04-14T12:48:06.230106Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:48:06.233Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:48:06.231Z InvocationID=75a7832a-bc00-4a7d-abc9-9c5049205f64 LogTimestamp=2021-04-14T12:48:06.233245Z ResponseDesc=OK Exiting. 2021-04-14T12:48:06.233Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:48:08.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23cc6a46-1243-45a7-9cd0-f31f4526b7ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:08.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23cc6a46-1243-45a7-9cd0-f31f4526b7ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@553a06ac 2021-04-14T12:48:08.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23cc6a46-1243-45a7-9cd0-f31f4526b7ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:08.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23cc6a46-1243-45a7-9cd0-f31f4526b7ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d332289-4541-4c86-9856-7ddfa21279c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d332289-4541-4c86-9856-7ddfa21279c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dad6532 2021-04-14T12:48:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d332289-4541-4c86-9856-7ddfa21279c1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d332289-4541-4c86-9856-7ddfa21279c1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e25eb6-6747-4318-8aea-3550d5adacb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e25eb6-6747-4318-8aea-3550d5adacb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50112031 2021-04-14T12:48:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e25eb6-6747-4318-8aea-3550d5adacb6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:14.683Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74e25eb6-6747-4318-8aea-3550d5adacb6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:17.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d7b3a6-0569-4e2c-94a0-00295801e175 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:17.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d7b3a6-0569-4e2c-94a0-00295801e175 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56d21e92 2021-04-14T12:48:17.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d7b3a6-0569-4e2c-94a0-00295801e175 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:17.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=36d7b3a6-0569-4e2c-94a0-00295801e175 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44577a25-f519-4fbb-b6f3-f902f99e087a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44577a25-f519-4fbb-b6f3-f902f99e087a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53586d82 2021-04-14T12:48:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44577a25-f519-4fbb-b6f3-f902f99e087a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:20.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44577a25-f519-4fbb-b6f3-f902f99e087a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25adec95-2d6a-4c65-a3c0-12c7e07103b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25adec95-2d6a-4c65-a3c0-12c7e07103b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@757a162e 2021-04-14T12:48:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25adec95-2d6a-4c65-a3c0-12c7e07103b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25adec95-2d6a-4c65-a3c0-12c7e07103b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:27.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e9f49b-ca51-463c-b7d0-10e5c5cbaf00 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:27.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e9f49b-ca51-463c-b7d0-10e5c5cbaf00 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c33b018 2021-04-14T12:48:27.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e9f49b-ca51-463c-b7d0-10e5c5cbaf00 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:27.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30e9f49b-ca51-463c-b7d0-10e5c5cbaf00 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:29.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05ac326d-aee0-4574-9014-41064aaa2ea1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:29.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05ac326d-aee0-4574-9014-41064aaa2ea1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a530d82 2021-04-14T12:48:29.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05ac326d-aee0-4574-9014-41064aaa2ea1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:29.817Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05ac326d-aee0-4574-9014-41064aaa2ea1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b26d2990-fb0b-4d61-aa15-e5da7892af57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b26d2990-fb0b-4d61-aa15-e5da7892af57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7af75937 2021-04-14T12:48:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b26d2990-fb0b-4d61-aa15-e5da7892af57 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b26d2990-fb0b-4d61-aa15-e5da7892af57 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:36.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a71322-c635-4611-a0b0-71886a69947e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:36.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a71322-c635-4611-a0b0-71886a69947e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f19fb21 2021-04-14T12:48:36.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a71322-c635-4611-a0b0-71886a69947e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:36.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56a71322-c635-4611-a0b0-71886a69947e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:36.244Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=103b1611-80cb-4521-9dbb-fdcdc6649f7e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:48:36.244721Z InvocationID=0733f3aa-c6ef-498b-a069-8b19279110ba LogTimestamp=2021-04-14T12:48:36.244783Z Entering 2021-04-14T12:48:36.245Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=103b1611-80cb-4521-9dbb-fdcdc6649f7e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:48:36.244721Z InvocationID=0733f3aa-c6ef-498b-a069-8b19279110ba LogTimestamp=2021-04-14T12:48:36.244783Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:48:36.246Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:48:36.245Z InvocationID=f4c3b79b-4c1a-48e5-b496-7ab45a9bb5a2 LogTimestamp=2021-04-14T12:48:36.246263Z ResponseDesc=OK Exiting. 2021-04-14T12:48:36.246Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:48:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceaf0d6e-8283-4f0d-9837-df7eedefd399 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceaf0d6e-8283-4f0d-9837-df7eedefd399 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e9b33aa 2021-04-14T12:48:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceaf0d6e-8283-4f0d-9837-df7eedefd399 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ceaf0d6e-8283-4f0d-9837-df7eedefd399 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e655f78-925e-4543-b30f-2d0961152a19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e655f78-925e-4543-b30f-2d0961152a19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cd61ce6 2021-04-14T12:48:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e655f78-925e-4543-b30f-2d0961152a19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:41.596Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e655f78-925e-4543-b30f-2d0961152a19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:45.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026f2012-c9b9-48a5-96f4-1ba44e8c2575 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:45.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026f2012-c9b9-48a5-96f4-1ba44e8c2575 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c28c0aa 2021-04-14T12:48:45.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026f2012-c9b9-48a5-96f4-1ba44e8c2575 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:45.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=026f2012-c9b9-48a5-96f4-1ba44e8c2575 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:48:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:48:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47ff2761-3aac-417f-84b9-e410a0529b3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47ff2761-3aac-417f-84b9-e410a0529b3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c78e8fd 2021-04-14T12:48:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47ff2761-3aac-417f-84b9-e410a0529b3e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:48.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=47ff2761-3aac-417f-84b9-e410a0529b3e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0a055f-cd51-498a-a4b3-456a56d49c46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0a055f-cd51-498a-a4b3-456a56d49c46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bc984bb 2021-04-14T12:48:51.225Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0a055f-cd51-498a-a4b3-456a56d49c46 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:51.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a0a055f-cd51-498a-a4b3-456a56d49c46 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:53.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fef1c385-8a46-4abd-9e57-6121f7defa50 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:53.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fef1c385-8a46-4abd-9e57-6121f7defa50 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57548608 2021-04-14T12:48:53.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fef1c385-8a46-4abd-9e57-6121f7defa50 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:53.950Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fef1c385-8a46-4abd-9e57-6121f7defa50 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:56.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54246453-3167-4171-8680-3f8ce1345fe2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:56.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54246453-3167-4171-8680-3f8ce1345fe2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4de331d8 2021-04-14T12:48:56.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54246453-3167-4171-8680-3f8ce1345fe2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:56.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54246453-3167-4171-8680-3f8ce1345fe2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:48:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aff6de-71b1-4be2-917e-9b7be3d73895 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:48:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aff6de-71b1-4be2-917e-9b7be3d73895 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46571799 2021-04-14T12:48:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aff6de-71b1-4be2-917e-9b7be3d73895 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:48:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aff6de-71b1-4be2-917e-9b7be3d73895 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:03.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4fd4b17-cdb6-4324-a072-7c547958682f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:03.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4fd4b17-cdb6-4324-a072-7c547958682f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@710cafb4 2021-04-14T12:49:03.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4fd4b17-cdb6-4324-a072-7c547958682f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:03.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4fd4b17-cdb6-4324-a072-7c547958682f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:49:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:49:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:49:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:49:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:49:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:49:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42b745a3-22d9-4979-8bd9-86d350231bfc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42b745a3-22d9-4979-8bd9-86d350231bfc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29b135b 2021-04-14T12:49:06.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42b745a3-22d9-4979-8bd9-86d350231bfc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:06.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42b745a3-22d9-4979-8bd9-86d350231bfc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:06.241Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=98df2a78-990b-4e5c-8064-ae59626e43d4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:06.240305Z InvocationID=610a7572-22c2-49d7-806a-8f4a3eea440a LogTimestamp=2021-04-14T12:49:06.240427Z Entering 2021-04-14T12:49:06.241Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=98df2a78-990b-4e5c-8064-ae59626e43d4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:06.240305Z InvocationID=610a7572-22c2-49d7-806a-8f4a3eea440a LogTimestamp=2021-04-14T12:49:06.240427Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:49:06.243Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:49:06.241Z InvocationID=5f41cea6-08ab-416a-884e-d9cf8592ab39 LogTimestamp=2021-04-14T12:49:06.242860Z ResponseDesc=OK Exiting. 2021-04-14T12:49:06.243Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:49:08.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4917119-7c66-4a03-8abd-375015bf04ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:08.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4917119-7c66-4a03-8abd-375015bf04ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56228f21 2021-04-14T12:49:08.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4917119-7c66-4a03-8abd-375015bf04ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:08.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4917119-7c66-4a03-8abd-375015bf04ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:12.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308402a9-3c9e-474b-9aef-7588e5967367 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:12.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308402a9-3c9e-474b-9aef-7588e5967367 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2837a1a3 2021-04-14T12:49:12.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308402a9-3c9e-474b-9aef-7588e5967367 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:12.256Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=308402a9-3c9e-474b-9aef-7588e5967367 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af05246-eb80-4374-a2e4-672c05e7f5f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af05246-eb80-4374-a2e4-672c05e7f5f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cd2da1e 2021-04-14T12:49:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af05246-eb80-4374-a2e4-672c05e7f5f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:14.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0af05246-eb80-4374-a2e4-672c05e7f5f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:15.404Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bcd9163a-38d7-469c-83f1-c734b7ed1853 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:15.404520Z InvocationID=69e4b4f3-192d-4388-946b-92db7b137e43 LogTimestamp=2021-04-14T12:49:15.404567Z Entering 2021-04-14T12:49:15.406Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bcd9163a-38d7-469c-83f1-c734b7ed1853 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:15.404520Z InvocationID=69e4b4f3-192d-4388-946b-92db7b137e43 LogTimestamp=2021-04-14T12:49:15.404567Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:49:15.408Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:49:15.406Z InvocationID=01e94ff8-8428-4edf-b100-1bb329af06a2 LogTimestamp=2021-04-14T12:49:15.408566Z ResponseDesc=OK Exiting. 2021-04-14T12:49:15.412Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:49:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:18.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483fab1d-5b07-4c08-bc15-85e1b3f5e459 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:18.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483fab1d-5b07-4c08-bc15-85e1b3f5e459 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66090714 2021-04-14T12:49:18.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483fab1d-5b07-4c08-bc15-85e1b3f5e459 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:18.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=483fab1d-5b07-4c08-bc15-85e1b3f5e459 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c24e3d4-7307-45bd-b43b-1dbdc378c377 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c24e3d4-7307-45bd-b43b-1dbdc378c377 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2490d773 2021-04-14T12:49:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c24e3d4-7307-45bd-b43b-1dbdc378c377 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c24e3d4-7307-45bd-b43b-1dbdc378c377 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55805464-09a8-4092-a4dc-9743c49df6f8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55805464-09a8-4092-a4dc-9743c49df6f8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@313f40fb 2021-04-14T12:49:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55805464-09a8-4092-a4dc-9743c49df6f8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55805464-09a8-4092-a4dc-9743c49df6f8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb5981-c447-4495-b88c-7bc323f01199 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb5981-c447-4495-b88c-7bc323f01199 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b176ee8 2021-04-14T12:49:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb5981-c447-4495-b88c-7bc323f01199 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17cb5981-c447-4495-b88c-7bc323f01199 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa435ad-3740-4e7d-aaaf-17fd35e62908 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa435ad-3740-4e7d-aaaf-17fd35e62908 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3508fb39 2021-04-14T12:49:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa435ad-3740-4e7d-aaaf-17fd35e62908 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:29.914Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fa435ad-3740-4e7d-aaaf-17fd35e62908 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:33.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a796707-0b12-4c4a-8027-750afbae2bd6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:33.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a796707-0b12-4c4a-8027-750afbae2bd6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@170199a4 2021-04-14T12:49:33.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a796707-0b12-4c4a-8027-750afbae2bd6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:33.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a796707-0b12-4c4a-8027-750afbae2bd6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e193565f-861f-4418-bc3b-f5e2f38d1306 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e193565f-861f-4418-bc3b-f5e2f38d1306 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cf23b27 2021-04-14T12:49:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e193565f-861f-4418-bc3b-f5e2f38d1306 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e193565f-861f-4418-bc3b-f5e2f38d1306 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:36.232Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c82ffa42-e7c3-4d06-a06b-a7530e69aeb7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:36.232019Z InvocationID=746ffc5f-b5aa-4fe4-86aa-c0ac483444db LogTimestamp=2021-04-14T12:49:36.232084Z Entering 2021-04-14T12:49:36.232Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c82ffa42-e7c3-4d06-a06b-a7530e69aeb7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:36.232019Z InvocationID=746ffc5f-b5aa-4fe4-86aa-c0ac483444db LogTimestamp=2021-04-14T12:49:36.232084Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:49:36.234Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:49:36.232Z InvocationID=671915ec-2a1e-41cb-acb0-74a1a056f1cf LogTimestamp=2021-04-14T12:49:36.234263Z ResponseDesc=OK Exiting. 2021-04-14T12:49:36.234Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:49:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3585eeef-7a49-4fe2-b80e-50004b8d555b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3585eeef-7a49-4fe2-b80e-50004b8d555b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c326e7f 2021-04-14T12:49:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3585eeef-7a49-4fe2-b80e-50004b8d555b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:39.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3585eeef-7a49-4fe2-b80e-50004b8d555b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:41.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40ffbb9-dce8-40fc-9a57-2e964e5f256c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:41.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40ffbb9-dce8-40fc-9a57-2e964e5f256c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e9183f3 2021-04-14T12:49:41.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40ffbb9-dce8-40fc-9a57-2e964e5f256c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:41.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c40ffbb9-dce8-40fc-9a57-2e964e5f256c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ab4bac-a5ac-4df3-a650-f380f6239f5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ab4bac-a5ac-4df3-a650-f380f6239f5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1546f73c 2021-04-14T12:49:45.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ab4bac-a5ac-4df3-a650-f380f6239f5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:45.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1ab4bac-a5ac-4df3-a650-f380f6239f5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:49:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:49:47.908Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bf30b9-bedc-440e-983f-142813d51287 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:47.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bf30b9-bedc-440e-983f-142813d51287 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5820ddb0 2021-04-14T12:49:47.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bf30b9-bedc-440e-983f-142813d51287 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:47.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0bf30b9-bedc-440e-983f-142813d51287 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:48.230Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=09c58457-faae-4c30-9e28-17073849d060 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:48.229363Z InvocationID=c8f58896-d544-4ee9-a4e0-63d5027f8aff LogTimestamp=2021-04-14T12:49:48.229722Z Entering 2021-04-14T12:49:48.230Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=09c58457-faae-4c30-9e28-17073849d060 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:49:48.229363Z InvocationID=c8f58896-d544-4ee9-a4e0-63d5027f8aff LogTimestamp=2021-04-14T12:49:48.229722Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:49:48.232Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:49:48.230Z InvocationID=f06eee4c-40e6-491b-8595-6ad1001828c2 LogTimestamp=2021-04-14T12:49:48.232650Z ResponseDesc=OK Exiting. 2021-04-14T12:49:48.232Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:49:51.623Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a10122-8872-4591-ab3d-c44a3e3bb104 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:51.623Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a10122-8872-4591-ab3d-c44a3e3bb104 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@378e015d 2021-04-14T12:49:51.623Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a10122-8872-4591-ab3d-c44a3e3bb104 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:51.624Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1a10122-8872-4591-ab3d-c44a3e3bb104 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:53.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5b11c7-1538-491b-8470-e83fcc787b23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5b11c7-1538-491b-8470-e83fcc787b23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35828244 2021-04-14T12:49:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5b11c7-1538-491b-8470-e83fcc787b23 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5b11c7-1538-491b-8470-e83fcc787b23 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96b89002-5152-44ca-ab80-78f658d59207 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96b89002-5152-44ca-ab80-78f658d59207 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@175f6cdf 2021-04-14T12:49:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96b89002-5152-44ca-ab80-78f658d59207 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:56.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=96b89002-5152-44ca-ab80-78f658d59207 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:49:59.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42f2c5a5-53bf-4935-b3a9-71fe5733ce56 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:49:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42f2c5a5-53bf-4935-b3a9-71fe5733ce56 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49ccfed9 2021-04-14T12:49:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42f2c5a5-53bf-4935-b3a9-71fe5733ce56 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:49:59.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42f2c5a5-53bf-4935-b3a9-71fe5733ce56 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e02cd867-14b6-4572-85c2-eae73a41d9d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e02cd867-14b6-4572-85c2-eae73a41d9d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e8f9a54 2021-04-14T12:50:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e02cd867-14b6-4572-85c2-eae73a41d9d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e02cd867-14b6-4572-85c2-eae73a41d9d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:50:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:50:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:50:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:50:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:50:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:50:06.251Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=42621c3e-e46b-42dc-bd12-27d7fde16f96 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:50:06.251435Z InvocationID=5d833c70-930b-4cf3-9047-820ac3e79889 LogTimestamp=2021-04-14T12:50:06.251495Z Entering 2021-04-14T12:50:06.251Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=42621c3e-e46b-42dc-bd12-27d7fde16f96 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:50:06.251435Z InvocationID=5d833c70-930b-4cf3-9047-820ac3e79889 LogTimestamp=2021-04-14T12:50:06.251495Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:50:06.253Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:50:06.251Z InvocationID=472dc9b3-0a1b-4a18-80f1-530f379d9f90 LogTimestamp=2021-04-14T12:50:06.253055Z ResponseDesc=OK Exiting. 2021-04-14T12:50:06.253Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:50:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdeac1d-bea5-4dad-8a17-3511d008bb71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdeac1d-bea5-4dad-8a17-3511d008bb71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f3eb963 2021-04-14T12:50:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdeac1d-bea5-4dad-8a17-3511d008bb71 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6fdeac1d-bea5-4dad-8a17-3511d008bb71 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff9261f-a161-4911-b578-cec961b4fb4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff9261f-a161-4911-b578-cec961b4fb4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43eb01cf 2021-04-14T12:50:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff9261f-a161-4911-b578-cec961b4fb4a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eff9261f-a161-4911-b578-cec961b4fb4a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:12.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7c1196-62e6-4811-af2d-a4202f2865c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:12.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7c1196-62e6-4811-af2d-a4202f2865c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dff055d 2021-04-14T12:50:12.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7c1196-62e6-4811-af2d-a4202f2865c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:12.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7a7c1196-62e6-4811-af2d-a4202f2865c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e70fbdb-4c14-4af3-8a33-8ac1b941b7cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e70fbdb-4c14-4af3-8a33-8ac1b941b7cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f506f8c 2021-04-14T12:50:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e70fbdb-4c14-4af3-8a33-8ac1b941b7cf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e70fbdb-4c14-4af3-8a33-8ac1b941b7cf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:16.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:16.209Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:16.210Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:16.211Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:17.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491babb9-5645-4ca4-92fe-f225a68cf3b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:17.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491babb9-5645-4ca4-92fe-f225a68cf3b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45ff28a4 2021-04-14T12:50:17.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491babb9-5645-4ca4-92fe-f225a68cf3b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:17.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=491babb9-5645-4ca4-92fe-f225a68cf3b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e32e50-5ac0-469b-a2b3-b8d7c9e60c92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e32e50-5ac0-469b-a2b3-b8d7c9e60c92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e01acad 2021-04-14T12:50:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e32e50-5ac0-469b-a2b3-b8d7c9e60c92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:20.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=21e32e50-5ac0-469b-a2b3-b8d7c9e60c92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9c3476a-4f1d-4563-afc3-bb21331786a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9c3476a-4f1d-4563-afc3-bb21331786a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b418fdd 2021-04-14T12:50:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9c3476a-4f1d-4563-afc3-bb21331786a9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d9c3476a-4f1d-4563-afc3-bb21331786a9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6c26b43-37c0-41e6-a399-a154a5958511 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:26.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6c26b43-37c0-41e6-a399-a154a5958511 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5771a536 2021-04-14T12:50:26.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6c26b43-37c0-41e6-a399-a154a5958511 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:26.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6c26b43-37c0-41e6-a399-a154a5958511 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:29.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e00a07-5747-4aef-ab37-120588e308b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e00a07-5747-4aef-ab37-120588e308b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bf71d74 2021-04-14T12:50:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e00a07-5747-4aef-ab37-120588e308b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:29.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52e00a07-5747-4aef-ab37-120588e308b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:33.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1495142-51d9-47b9-8296-0bdff5f8fb4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:33.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1495142-51d9-47b9-8296-0bdff5f8fb4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3840b063 2021-04-14T12:50:33.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1495142-51d9-47b9-8296-0bdff5f8fb4f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:33.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1495142-51d9-47b9-8296-0bdff5f8fb4f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0adfslstjufag1dnhw6pc0u6m9334 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01edg5jjkcbpxgr5pbbnu1iknx326 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xzf2eeox6tiy9ktaoxg3f3b4349 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s7u4kid9sktw1h08yzbr8ss1u342 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0r1scs8oxflbdvifjar99xc5h328 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ya0vsjc8saa95ln0r0myy892343 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0197mv4bi4qupvbef8tl3yggvy338 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012imy34yxbsrg1pr1zihregqp6337 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0r2ir8pfpckig1cv2bv4pw7mwx333 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s62ndjinc25eylca7uipckqy339 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01k8n7w1jx0ck613jo2wmgplm9g325 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dw3ox3e8bdy6vf5l5xqs68px345 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mikj04ci32oigbpzcdl495sv346 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node03kugsycbhl63tze9eaigmym5335 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0194x1q9alxuha7hsoh51o9mv6331 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01euvr9q4seetusrwjhns0xt1y340 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ue5pq1v9fdcq1m6f3tmag4oqv330 2021-04-14T12:50:34.623Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lqp0ofx5hl15zscz1iutzqw4332 2021-04-14T12:50:34.624Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0sxv4y2njo3iurux040tg4fmh352 2021-04-14T12:50:34.624Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cr46jobbshqz1vdh8dt54qaux324 2021-04-14T12:50:34.624Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05gohj9cdsvmf1s4m1qq1s37ub348 2021-04-14T12:50:34.624Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0e86x099l3ikp1uaugmgzmecv9350 2021-04-14T12:50:34.624Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node029jzi7asl6lg1j33ijifhfkea341 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01rltlfa0wu08mop4rowwpzvn9351 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0dalmgklwjsyc1lo5nr5qmc64x327 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xib16l8u8tj8mbvodc1p8edn323 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018l23kz9drfa2t97jstaxuy1p329 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0upm7e69cpw9m1s1r4hseng5y3344 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01jh4oz2gei1pn14zrcdpt4cnd7347 2021-04-14T12:50:34.627Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01mqlojcptwy8t35392voctc5z336 2021-04-14T12:50:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0270b8c0-e2f3-4e40-b56c-e4409f6d2233 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0270b8c0-e2f3-4e40-b56c-e4409f6d2233 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f38ffd1 2021-04-14T12:50:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0270b8c0-e2f3-4e40-b56c-e4409f6d2233 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0270b8c0-e2f3-4e40-b56c-e4409f6d2233 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:36.241Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2ec4e45b-ee85-481d-aa0e-a4f1893d8b44 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:50:36.241489Z InvocationID=fe2c10a4-c6ee-48e2-9699-dc18561dc156 LogTimestamp=2021-04-14T12:50:36.241544Z Entering 2021-04-14T12:50:36.242Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2ec4e45b-ee85-481d-aa0e-a4f1893d8b44 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:50:36.241489Z InvocationID=fe2c10a4-c6ee-48e2-9699-dc18561dc156 LogTimestamp=2021-04-14T12:50:36.241544Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:50:36.243Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:50:36.242Z InvocationID=b203c308-bbc3-4ff5-be60-b50d0ccf830a LogTimestamp=2021-04-14T12:50:36.243898Z ResponseDesc=OK Exiting. 2021-04-14T12:50:36.244Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:50:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b40b50-d0cf-484e-9daa-44dde9885a82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b40b50-d0cf-484e-9daa-44dde9885a82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25baad15 2021-04-14T12:50:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b40b50-d0cf-484e-9daa-44dde9885a82 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:38.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55b40b50-d0cf-484e-9daa-44dde9885a82 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84016bf8-b97a-48f2-b487-901d80907ac7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84016bf8-b97a-48f2-b487-901d80907ac7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7675086b 2021-04-14T12:50:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84016bf8-b97a-48f2-b487-901d80907ac7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84016bf8-b97a-48f2-b487-901d80907ac7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43f0dbaa-5e3e-4249-bf9d-6f0297a3e45e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43f0dbaa-5e3e-4249-bf9d-6f0297a3e45e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b0b7d6e 2021-04-14T12:50:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43f0dbaa-5e3e-4249-bf9d-6f0297a3e45e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43f0dbaa-5e3e-4249-bf9d-6f0297a3e45e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:50:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:50:47.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee39de87-70cb-4db2-9c10-5d11e5a6295e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:47.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee39de87-70cb-4db2-9c10-5d11e5a6295e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73f5c5a9 2021-04-14T12:50:47.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee39de87-70cb-4db2-9c10-5d11e5a6295e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:47.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee39de87-70cb-4db2-9c10-5d11e5a6295e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1259e1-f5f3-45c5-8caa-f5592bd624e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1259e1-f5f3-45c5-8caa-f5592bd624e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d71cc7 2021-04-14T12:50:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1259e1-f5f3-45c5-8caa-f5592bd624e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b1259e1-f5f3-45c5-8caa-f5592bd624e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:53.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e91883-65c4-44ff-91d7-f227bc03ea77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:53.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e91883-65c4-44ff-91d7-f227bc03ea77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dbf6a86 2021-04-14T12:50:53.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e91883-65c4-44ff-91d7-f227bc03ea77 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:53.845Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1e91883-65c4-44ff-91d7-f227bc03ea77 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:56.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c36f995c-6d16-4e3b-b37d-d7dba9164458 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:56.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c36f995c-6d16-4e3b-b37d-d7dba9164458 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d4f9c52 2021-04-14T12:50:56.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c36f995c-6d16-4e3b-b37d-d7dba9164458 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:56.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c36f995c-6d16-4e3b-b37d-d7dba9164458 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:50:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e75fc469-6dfd-40c3-8d51-0454dd5f2d03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:50:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e75fc469-6dfd-40c3-8d51-0454dd5f2d03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@104ad0df 2021-04-14T12:50:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e75fc469-6dfd-40c3-8d51-0454dd5f2d03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:50:59.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e75fc469-6dfd-40c3-8d51-0454dd5f2d03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:02.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf640d07-bd92-4bf8-bfb5-6844c53b2d91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:02.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf640d07-bd92-4bf8-bfb5-6844c53b2d91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b40c735 2021-04-14T12:51:02.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf640d07-bd92-4bf8-bfb5-6844c53b2d91 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:02.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf640d07-bd92-4bf8-bfb5-6844c53b2d91 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:51:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:51:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:51:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:51:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:51:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:51:06.234Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=be90ece1-e998-40a4-b73c-98d716e28260 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:51:06.233901Z InvocationID=47f2442a-d162-4c1f-b410-10af915b7116 LogTimestamp=2021-04-14T12:51:06.233978Z Entering 2021-04-14T12:51:06.234Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=be90ece1-e998-40a4-b73c-98d716e28260 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:51:06.233901Z InvocationID=47f2442a-d162-4c1f-b410-10af915b7116 LogTimestamp=2021-04-14T12:51:06.233978Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:51:06.236Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:51:06.234Z InvocationID=0ffdd0b1-7fd5-48b6-b473-352c20aef8e2 LogTimestamp=2021-04-14T12:51:06.236304Z ResponseDesc=OK Exiting. 2021-04-14T12:51:06.236Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:51:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a3a086-1bd7-4287-a5f6-cacd955f2a19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a3a086-1bd7-4287-a5f6-cacd955f2a19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d8d7381 2021-04-14T12:51:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a3a086-1bd7-4287-a5f6-cacd955f2a19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00a3a086-1bd7-4287-a5f6-cacd955f2a19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e024b23-7a21-4c27-8998-769b81f6ad36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e024b23-7a21-4c27-8998-769b81f6ad36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c91d36e 2021-04-14T12:51:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e024b23-7a21-4c27-8998-769b81f6ad36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e024b23-7a21-4c27-8998-769b81f6ad36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e25a1b-66c8-4a79-9505-124c45501b8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e25a1b-66c8-4a79-9505-124c45501b8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a1b200b 2021-04-14T12:51:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e25a1b-66c8-4a79-9505-124c45501b8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e25a1b-66c8-4a79-9505-124c45501b8f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=481bb27a-0932-4074-ac71-e53833bc957a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=481bb27a-0932-4074-ac71-e53833bc957a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@574f2912 2021-04-14T12:51:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=481bb27a-0932-4074-ac71-e53833bc957a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=481bb27a-0932-4074-ac71-e53833bc957a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:17.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=933d57d2-6bca-474b-bfd7-241f0516a9ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:17.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=933d57d2-6bca-474b-bfd7-241f0516a9ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31385901 2021-04-14T12:51:17.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=933d57d2-6bca-474b-bfd7-241f0516a9ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:17.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=933d57d2-6bca-474b-bfd7-241f0516a9ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2682ff3-23f3-4a86-9c79-9e8ca74d9366 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2682ff3-23f3-4a86-9c79-9e8ca74d9366 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@300e6eb 2021-04-14T12:51:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2682ff3-23f3-4a86-9c79-9e8ca74d9366 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c2682ff3-23f3-4a86-9c79-9e8ca74d9366 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f9382e-559d-4f08-ad98-fefa756b3730 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f9382e-559d-4f08-ad98-fefa756b3730 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@203895f8 2021-04-14T12:51:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f9382e-559d-4f08-ad98-fefa756b3730 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79f9382e-559d-4f08-ad98-fefa756b3730 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:27.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf7722c1-e9c1-41f0-b324-e8d8b6e4ac0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:27.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf7722c1-e9c1-41f0-b324-e8d8b6e4ac0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e913f54 2021-04-14T12:51:27.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf7722c1-e9c1-41f0-b324-e8d8b6e4ac0d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:27.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf7722c1-e9c1-41f0-b324-e8d8b6e4ac0d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45716a6b-1316-47c0-921e-8c753aea21f9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:30.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45716a6b-1316-47c0-921e-8c753aea21f9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d129fd6 2021-04-14T12:51:30.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45716a6b-1316-47c0-921e-8c753aea21f9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:30.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=45716a6b-1316-47c0-921e-8c753aea21f9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8b4aee-8e1d-42a4-a9df-7a2feb3a04ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8b4aee-8e1d-42a4-a9df-7a2feb3a04ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79a11921 2021-04-14T12:51:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8b4aee-8e1d-42a4-a9df-7a2feb3a04ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:33.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8b4aee-8e1d-42a4-a9df-7a2feb3a04ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:35.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b83f9ef-b545-4658-96ed-2522df0d1554 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:35.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b83f9ef-b545-4658-96ed-2522df0d1554 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d52c4b8 2021-04-14T12:51:35.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b83f9ef-b545-4658-96ed-2522df0d1554 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:35.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b83f9ef-b545-4658-96ed-2522df0d1554 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:36.234Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=60a63bdc-1d93-4f13-8998-96343ac59c14 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:51:36.233536Z InvocationID=54631058-c5a4-4b9a-9931-2cdee51710de LogTimestamp=2021-04-14T12:51:36.233658Z Entering 2021-04-14T12:51:36.234Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=60a63bdc-1d93-4f13-8998-96343ac59c14 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:51:36.233536Z InvocationID=54631058-c5a4-4b9a-9931-2cdee51710de LogTimestamp=2021-04-14T12:51:36.233658Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:51:36.236Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:51:36.234Z InvocationID=72487173-d769-491e-8f24-c9f9811f46aa LogTimestamp=2021-04-14T12:51:36.236789Z ResponseDesc=OK Exiting. 2021-04-14T12:51:36.237Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:51:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e03cb2-e9c9-4adc-b331-a28f9f88453e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e03cb2-e9c9-4adc-b331-a28f9f88453e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1abe23d9 2021-04-14T12:51:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e03cb2-e9c9-4adc-b331-a28f9f88453e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:38.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7e03cb2-e9c9-4adc-b331-a28f9f88453e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe45d5b-f62f-4e58-b96a-c6eda13fbdcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe45d5b-f62f-4e58-b96a-c6eda13fbdcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73bbe377 2021-04-14T12:51:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe45d5b-f62f-4e58-b96a-c6eda13fbdcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fe45d5b-f62f-4e58-b96a-c6eda13fbdcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:44.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12d665d9-7e3a-4934-b658-0e60ed4d55a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:44.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12d665d9-7e3a-4934-b658-0e60ed4d55a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2228430 2021-04-14T12:51:44.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12d665d9-7e3a-4934-b658-0e60ed4d55a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:44.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12d665d9-7e3a-4934-b658-0e60ed4d55a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:51:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:51:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ba5bba4-c8f0-4289-b5ce-79cdd84bc536 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ba5bba4-c8f0-4289-b5ce-79cdd84bc536 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@95ef7c8 2021-04-14T12:51:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ba5bba4-c8f0-4289-b5ce-79cdd84bc536 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ba5bba4-c8f0-4289-b5ce-79cdd84bc536 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:48.231Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9bb6d57d-73ef-44d3-90bb-01cf9aa1f679 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:51:48.230851Z InvocationID=1d4cf25a-62b8-47e2-862f-b664cf6e09ee LogTimestamp=2021-04-14T12:51:48.230893Z Entering 2021-04-14T12:51:48.231Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9bb6d57d-73ef-44d3-90bb-01cf9aa1f679 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:51:48.230851Z InvocationID=1d4cf25a-62b8-47e2-862f-b664cf6e09ee LogTimestamp=2021-04-14T12:51:48.230893Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:51:48.232Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:51:48.231Z InvocationID=fcf1131f-2b16-4164-891d-b61e3c85ae0f LogTimestamp=2021-04-14T12:51:48.232931Z ResponseDesc=OK Exiting. 2021-04-14T12:51:48.233Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:51:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=854d8650-dc52-46ca-822b-82c299a7c7e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=854d8650-dc52-46ca-822b-82c299a7c7e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6215bdd1 2021-04-14T12:51:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=854d8650-dc52-46ca-822b-82c299a7c7e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:51.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=854d8650-dc52-46ca-822b-82c299a7c7e6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:53.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7ab48e-a0fe-4b2a-9ea5-df6fdcaf3bdb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:53.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7ab48e-a0fe-4b2a-9ea5-df6fdcaf3bdb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e995abf 2021-04-14T12:51:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7ab48e-a0fe-4b2a-9ea5-df6fdcaf3bdb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:53.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae7ab48e-a0fe-4b2a-9ea5-df6fdcaf3bdb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:56.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=565b81ea-5b83-451b-ad16-d99fa8a10e43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:56.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=565b81ea-5b83-451b-ad16-d99fa8a10e43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@588c4458 2021-04-14T12:51:56.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=565b81ea-5b83-451b-ad16-d99fa8a10e43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:56.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=565b81ea-5b83-451b-ad16-d99fa8a10e43 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:51:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6896b6-38db-465f-b21b-fa7cb548a47f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:51:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6896b6-38db-465f-b21b-fa7cb548a47f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26920836 2021-04-14T12:51:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6896b6-38db-465f-b21b-fa7cb548a47f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:51:59.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a6896b6-38db-465f-b21b-fa7cb548a47f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4f8ee41-9ac5-4be7-ab06-829b07354d86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4f8ee41-9ac5-4be7-ab06-829b07354d86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6926c200 2021-04-14T12:52:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4f8ee41-9ac5-4be7-ab06-829b07354d86 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4f8ee41-9ac5-4be7-ab06-829b07354d86 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:52:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:52:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:52:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:52:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:52:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:52:06.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1798c8c8-2027-4719-b097-48d33a63f4fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:06.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1798c8c8-2027-4719-b097-48d33a63f4fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d6e2139 2021-04-14T12:52:06.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1798c8c8-2027-4719-b097-48d33a63f4fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:06.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1798c8c8-2027-4719-b097-48d33a63f4fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:06.240Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8e6e9dee-ba7d-4ef0-8caa-f58ad43e82ad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:52:06.239994Z InvocationID=be27492e-96c6-4b7a-af99-bd615d043eac LogTimestamp=2021-04-14T12:52:06.240077Z Entering 2021-04-14T12:52:06.240Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8e6e9dee-ba7d-4ef0-8caa-f58ad43e82ad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:52:06.239994Z InvocationID=be27492e-96c6-4b7a-af99-bd615d043eac LogTimestamp=2021-04-14T12:52:06.240077Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:52:06.243Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:52:06.240Z InvocationID=f7ac18d6-02bf-4188-abab-44b8956357ef LogTimestamp=2021-04-14T12:52:06.242946Z ResponseDesc=OK Exiting. 2021-04-14T12:52:06.243Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:52:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=882cd7ad-d618-451a-bc0a-2079ada8fd34 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=882cd7ad-d618-451a-bc0a-2079ada8fd34 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@577a0648 2021-04-14T12:52:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=882cd7ad-d618-451a-bc0a-2079ada8fd34 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=882cd7ad-d618-451a-bc0a-2079ada8fd34 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8668c90a-b2ea-4874-ac8a-4ac858213293 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8668c90a-b2ea-4874-ac8a-4ac858213293 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@611f7729 2021-04-14T12:52:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8668c90a-b2ea-4874-ac8a-4ac858213293 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8668c90a-b2ea-4874-ac8a-4ac858213293 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d577f5a4-b827-4468-9cce-08997e5b7d24 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d577f5a4-b827-4468-9cce-08997e5b7d24 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e768fc8 2021-04-14T12:52:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d577f5a4-b827-4468-9cce-08997e5b7d24 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:14.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d577f5a4-b827-4468-9cce-08997e5b7d24 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:16.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=086c45c0-6d58-465e-82af-1666ff8045ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=086c45c0-6d58-465e-82af-1666ff8045ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@220d06d6 2021-04-14T12:52:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=086c45c0-6d58-465e-82af-1666ff8045ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=086c45c0-6d58-465e-82af-1666ff8045ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23871cdd-176e-49a5-96b0-285624f4e399 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23871cdd-176e-49a5-96b0-285624f4e399 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25420c99 2021-04-14T12:52:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23871cdd-176e-49a5-96b0-285624f4e399 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23871cdd-176e-49a5-96b0-285624f4e399 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0f23cf-f608-4103-9ff2-c6e01ccaa6b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0f23cf-f608-4103-9ff2-c6e01ccaa6b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f7e9127 2021-04-14T12:52:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0f23cf-f608-4103-9ff2-c6e01ccaa6b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e0f23cf-f608-4103-9ff2-c6e01ccaa6b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:26.957Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5be51f1e-63c8-41ac-8dde-f365c8c2141d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:52:26.956922Z InvocationID=7b8aa89a-29cd-426d-a01e-2050bd87e4cb LogTimestamp=2021-04-14T12:52:26.956981Z Entering 2021-04-14T12:52:26.957Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5be51f1e-63c8-41ac-8dde-f365c8c2141d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:52:26.956922Z InvocationID=7b8aa89a-29cd-426d-a01e-2050bd87e4cb LogTimestamp=2021-04-14T12:52:26.956981Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:52:26.958Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:52:26.957Z InvocationID=0af9212e-6e4a-4e73-ae4a-9b828116fdc7 LogTimestamp=2021-04-14T12:52:26.958443Z ResponseDesc=OK Exiting. 2021-04-14T12:52:26.959Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:52:27.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b449c2-0d84-4e25-9dc4-7ea51daf1bff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:27.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b449c2-0d84-4e25-9dc4-7ea51daf1bff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35fc41cf 2021-04-14T12:52:27.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b449c2-0d84-4e25-9dc4-7ea51daf1bff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:27.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b449c2-0d84-4e25-9dc4-7ea51daf1bff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:29.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f3d666-1dd6-4e9c-b335-6c7133bd317e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:29.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f3d666-1dd6-4e9c-b335-6c7133bd317e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f8dca10 2021-04-14T12:52:29.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f3d666-1dd6-4e9c-b335-6c7133bd317e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:29.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f3d666-1dd6-4e9c-b335-6c7133bd317e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103ebfdd-9967-4ff5-a0c7-e08150229a4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:32.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103ebfdd-9967-4ff5-a0c7-e08150229a4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a9e27bc 2021-04-14T12:52:32.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103ebfdd-9967-4ff5-a0c7-e08150229a4f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:32.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=103ebfdd-9967-4ff5-a0c7-e08150229a4f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b79c19f-d0a8-4755-bda1-ea22eb4ed541 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b79c19f-d0a8-4755-bda1-ea22eb4ed541 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1227061 2021-04-14T12:52:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b79c19f-d0a8-4755-bda1-ea22eb4ed541 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b79c19f-d0a8-4755-bda1-ea22eb4ed541 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:36.219Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=edf89da0-3c63-4505-9eaf-e3082303ad54 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:52:36.219127Z InvocationID=872a5dfd-1502-4889-b7d8-126d79991fab LogTimestamp=2021-04-14T12:52:36.219159Z Entering 2021-04-14T12:52:36.219Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=edf89da0-3c63-4505-9eaf-e3082303ad54 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:52:36.219127Z InvocationID=872a5dfd-1502-4889-b7d8-126d79991fab LogTimestamp=2021-04-14T12:52:36.219159Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:52:36.220Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:52:36.219Z InvocationID=6a90479f-6630-40e1-b7ae-3fc7fb009683 LogTimestamp=2021-04-14T12:52:36.220262Z ResponseDesc=OK Exiting. 2021-04-14T12:52:36.220Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:52:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb50d3a-a2c3-4170-acef-8ea5ff0671c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb50d3a-a2c3-4170-acef-8ea5ff0671c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5607bbb3 2021-04-14T12:52:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb50d3a-a2c3-4170-acef-8ea5ff0671c3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb50d3a-a2c3-4170-acef-8ea5ff0671c3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:41.606Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7d418ca-e75a-4b48-8b09-722621969844 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7d418ca-e75a-4b48-8b09-722621969844 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47cb3629 2021-04-14T12:52:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7d418ca-e75a-4b48-8b09-722621969844 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7d418ca-e75a-4b48-8b09-722621969844 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:45.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e701f91b-f27d-4100-b59b-6a04b923bfbc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:45.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e701f91b-f27d-4100-b59b-6a04b923bfbc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cd34aab 2021-04-14T12:52:45.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e701f91b-f27d-4100-b59b-6a04b923bfbc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:45.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e701f91b-f27d-4100-b59b-6a04b923bfbc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:52:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:52:47.798Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c56da75f-f349-4450-a8aa-fcd81e7fefb7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:47.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c56da75f-f349-4450-a8aa-fcd81e7fefb7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e609c28 2021-04-14T12:52:47.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c56da75f-f349-4450-a8aa-fcd81e7fefb7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:47.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c56da75f-f349-4450-a8aa-fcd81e7fefb7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:51.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb5a968f-fa37-4388-82da-8abd9fdd0cb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:51.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb5a968f-fa37-4388-82da-8abd9fdd0cb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5516874 2021-04-14T12:52:51.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb5a968f-fa37-4388-82da-8abd9fdd0cb4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb5a968f-fa37-4388-82da-8abd9fdd0cb4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:53.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c18fba7c-9b92-4abf-a47a-2cbb00abb999 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:53.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c18fba7c-9b92-4abf-a47a-2cbb00abb999 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bb57c89 2021-04-14T12:52:53.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c18fba7c-9b92-4abf-a47a-2cbb00abb999 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:53.856Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c18fba7c-9b92-4abf-a47a-2cbb00abb999 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:56.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c1ae473-e714-4314-9c76-29af7a66a0f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:56.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c1ae473-e714-4314-9c76-29af7a66a0f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7dd5eb46 2021-04-14T12:52:56.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c1ae473-e714-4314-9c76-29af7a66a0f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:56.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c1ae473-e714-4314-9c76-29af7a66a0f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:52:59.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f582180-5668-45ef-b32a-0a56eace54bb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:52:59.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f582180-5668-45ef-b32a-0a56eace54bb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@173ea908 2021-04-14T12:52:59.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f582180-5668-45ef-b32a-0a56eace54bb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:52:59.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f582180-5668-45ef-b32a-0a56eace54bb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:02.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a045def9-1587-49ed-a77d-d51ff0f7f150 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:02.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a045def9-1587-49ed-a77d-d51ff0f7f150 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19226153 2021-04-14T12:53:02.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a045def9-1587-49ed-a77d-d51ff0f7f150 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:02.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a045def9-1587-49ed-a77d-d51ff0f7f150 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:53:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:53:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:53:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:53:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:53:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:53:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee4c3dbe-11f3-4817-8721-999cfd8f4da2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:06.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee4c3dbe-11f3-4817-8721-999cfd8f4da2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29c317ca 2021-04-14T12:53:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee4c3dbe-11f3-4817-8721-999cfd8f4da2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee4c3dbe-11f3-4817-8721-999cfd8f4da2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:06.246Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c2e61961-166b-4dfb-87f2-fd2cc25e4621 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:06.245727Z InvocationID=2d3d99f3-f603-474d-a2f8-80d716276729 LogTimestamp=2021-04-14T12:53:06.245929Z Entering 2021-04-14T12:53:06.247Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c2e61961-166b-4dfb-87f2-fd2cc25e4621 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:06.245727Z InvocationID=2d3d99f3-f603-474d-a2f8-80d716276729 LogTimestamp=2021-04-14T12:53:06.245929Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:53:06.254Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=6 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:53:06.248Z InvocationID=3c67aae0-abba-42a2-9d0c-36d9cd8756a7 LogTimestamp=2021-04-14T12:53:06.254362Z ResponseDesc=OK Exiting. 2021-04-14T12:53:06.255Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:53:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4af42864-cd8a-4dee-860c-8ab1d4a4e2ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4af42864-cd8a-4dee-860c-8ab1d4a4e2ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b1e466f 2021-04-14T12:53:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4af42864-cd8a-4dee-860c-8ab1d4a4e2ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:08.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4af42864-cd8a-4dee-860c-8ab1d4a4e2ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8d5ec1-b92c-4edf-b668-b3fd587d9bf8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8d5ec1-b92c-4edf-b668-b3fd587d9bf8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@190ad6ed 2021-04-14T12:53:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8d5ec1-b92c-4edf-b668-b3fd587d9bf8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e8d5ec1-b92c-4edf-b668-b3fd587d9bf8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b2dcbc-4784-4d6c-81a5-dda2c14eb747 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b2dcbc-4784-4d6c-81a5-dda2c14eb747 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13a80466 2021-04-14T12:53:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b2dcbc-4784-4d6c-81a5-dda2c14eb747 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b2dcbc-4784-4d6c-81a5-dda2c14eb747 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:17.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49512b57-8980-437d-8f97-06facd897ecc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:17.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49512b57-8980-437d-8f97-06facd897ecc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22e42c9e 2021-04-14T12:53:17.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49512b57-8980-437d-8f97-06facd897ecc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:17.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49512b57-8980-437d-8f97-06facd897ecc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:20.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3731f0c8-e1c8-4790-ad42-1575266c8d04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:20.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3731f0c8-e1c8-4790-ad42-1575266c8d04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b402b93 2021-04-14T12:53:20.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3731f0c8-e1c8-4790-ad42-1575266c8d04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:20.519Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3731f0c8-e1c8-4790-ad42-1575266c8d04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:24.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac1073d-d3fa-492b-b1a7-f938d24e3d05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:24.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac1073d-d3fa-492b-b1a7-f938d24e3d05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64b22da8 2021-04-14T12:53:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac1073d-d3fa-492b-b1a7-f938d24e3d05 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bac1073d-d3fa-492b-b1a7-f938d24e3d05 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e72ec72-79af-4998-8dfa-4899cd0518c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e72ec72-79af-4998-8dfa-4899cd0518c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37ea9e6c 2021-04-14T12:53:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e72ec72-79af-4998-8dfa-4899cd0518c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:27.224Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e72ec72-79af-4998-8dfa-4899cd0518c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfe5066a-3373-43f2-bb4c-5276ea495998 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfe5066a-3373-43f2-bb4c-5276ea495998 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34e9d4d3 2021-04-14T12:53:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfe5066a-3373-43f2-bb4c-5276ea495998 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cfe5066a-3373-43f2-bb4c-5276ea495998 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a226a753-f62a-418a-a884-b33f2c5dd19b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a226a753-f62a-418a-a884-b33f2c5dd19b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1edf7d6e 2021-04-14T12:53:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a226a753-f62a-418a-a884-b33f2c5dd19b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a226a753-f62a-418a-a884-b33f2c5dd19b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2abb16d-41a1-41e0-a01e-a39ab9d8b04b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2abb16d-41a1-41e0-a01e-a39ab9d8b04b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bf5cc70 2021-04-14T12:53:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2abb16d-41a1-41e0-a01e-a39ab9d8b04b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2abb16d-41a1-41e0-a01e-a39ab9d8b04b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:36.230Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=837eab57-a45c-4b7c-89bf-9325190e1c2d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:36.230350Z InvocationID=545946e0-5ca6-4a7f-975a-fc0a49fcbbcc LogTimestamp=2021-04-14T12:53:36.230411Z Entering 2021-04-14T12:53:36.230Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=837eab57-a45c-4b7c-89bf-9325190e1c2d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:36.230350Z InvocationID=545946e0-5ca6-4a7f-975a-fc0a49fcbbcc LogTimestamp=2021-04-14T12:53:36.230411Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:53:36.232Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:53:36.230Z InvocationID=63a2aed5-e3ee-4557-b94e-b8e50642ebe7 LogTimestamp=2021-04-14T12:53:36.232575Z ResponseDesc=OK Exiting. 2021-04-14T12:53:36.232Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:53:36.775Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=27637046-c3f0-4b27-a768-507f8b2ba7d8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:36.775817Z InvocationID=53210079-92a0-48a7-88ff-dd15d6d53430 LogTimestamp=2021-04-14T12:53:36.775846Z Entering 2021-04-14T12:53:36.776Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=27637046-c3f0-4b27-a768-507f8b2ba7d8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:36.775817Z InvocationID=53210079-92a0-48a7-88ff-dd15d6d53430 LogTimestamp=2021-04-14T12:53:36.775846Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:53:36.776Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:53:36.776Z InvocationID=d3e4ec27-c18e-44e4-a780-1fe19aabed8b LogTimestamp=2021-04-14T12:53:36.776888Z ResponseDesc=OK Exiting. 2021-04-14T12:53:36.777Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:53:38.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5533d882-18fb-4a08-bbb0-37d68c7870cf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:38.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5533d882-18fb-4a08-bbb0-37d68c7870cf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@80f369c 2021-04-14T12:53:38.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5533d882-18fb-4a08-bbb0-37d68c7870cf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:38.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5533d882-18fb-4a08-bbb0-37d68c7870cf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:41.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020bc413-8c95-4cf6-8ca1-a8c93c97d0ad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:41.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020bc413-8c95-4cf6-8ca1-a8c93c97d0ad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@723a3402 2021-04-14T12:53:41.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020bc413-8c95-4cf6-8ca1-a8c93c97d0ad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:41.512Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=020bc413-8c95-4cf6-8ca1-a8c93c97d0ad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a39b5ced-f65c-4590-9f31-d1b76bfaeae2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a39b5ced-f65c-4590-9f31-d1b76bfaeae2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17eb0326 2021-04-14T12:53:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a39b5ced-f65c-4590-9f31-d1b76bfaeae2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a39b5ced-f65c-4590-9f31-d1b76bfaeae2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:53:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:53:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46345d4-3e58-42a3-b934-4ceb93db2a8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46345d4-3e58-42a3-b934-4ceb93db2a8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5238cbe7 2021-04-14T12:53:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46345d4-3e58-42a3-b934-4ceb93db2a8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f46345d4-3e58-42a3-b934-4ceb93db2a8f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:48.237Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7db415c3-1ec8-4e00-a9fe-eced8da28b09 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:48.237389Z InvocationID=9bc80931-40fc-47d5-9535-8e164ff2f07f LogTimestamp=2021-04-14T12:53:48.237435Z Entering 2021-04-14T12:53:48.237Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7db415c3-1ec8-4e00-a9fe-eced8da28b09 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:53:48.237389Z InvocationID=9bc80931-40fc-47d5-9535-8e164ff2f07f LogTimestamp=2021-04-14T12:53:48.237435Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:53:48.239Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:53:48.237Z InvocationID=16e853c0-72ee-4516-b51f-1447f8a33205 LogTimestamp=2021-04-14T12:53:48.238995Z ResponseDesc=OK Exiting. 2021-04-14T12:53:48.239Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:53:51.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1438fc4-67b0-4f2f-8b00-80781ee3a53c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:51.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1438fc4-67b0-4f2f-8b00-80781ee3a53c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23f2bcea 2021-04-14T12:53:51.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1438fc4-67b0-4f2f-8b00-80781ee3a53c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:51.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1438fc4-67b0-4f2f-8b00-80781ee3a53c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:53.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75536f65-7169-4198-824a-e7b900e25cd8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:53.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75536f65-7169-4198-824a-e7b900e25cd8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cb16b2 2021-04-14T12:53:53.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75536f65-7169-4198-824a-e7b900e25cd8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:53.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75536f65-7169-4198-824a-e7b900e25cd8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=133b65c8-f009-41f4-b9bf-2e847e1690fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=133b65c8-f009-41f4-b9bf-2e847e1690fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ff6d7be 2021-04-14T12:53:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=133b65c8-f009-41f4-b9bf-2e847e1690fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=133b65c8-f009-41f4-b9bf-2e847e1690fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:53:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b759c330-c03b-4200-9ba4-d69d31b77ba8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:53:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b759c330-c03b-4200-9ba4-d69d31b77ba8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b855a54 2021-04-14T12:53:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b759c330-c03b-4200-9ba4-d69d31b77ba8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:53:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b759c330-c03b-4200-9ba4-d69d31b77ba8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:02.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a9ba0f-3a3b-4336-abec-b4a51ebf45e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:02.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a9ba0f-3a3b-4336-abec-b4a51ebf45e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6da6b822 2021-04-14T12:54:02.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a9ba0f-3a3b-4336-abec-b4a51ebf45e7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:02.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32a9ba0f-3a3b-4336-abec-b4a51ebf45e7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:54:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:54:04.350Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:54:04.350Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:54:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:54:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:54:06.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184c21c9-7e61-46c9-918f-abcb3ba847dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184c21c9-7e61-46c9-918f-abcb3ba847dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35805da2 2021-04-14T12:54:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184c21c9-7e61-46c9-918f-abcb3ba847dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=184c21c9-7e61-46c9-918f-abcb3ba847dd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:06.227Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=883e6e5a-64a1-4cec-ac13-3213bde9ed30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:54:06.227326Z InvocationID=4277119a-9b28-4987-802e-d29ecd5c58bc LogTimestamp=2021-04-14T12:54:06.227365Z Entering 2021-04-14T12:54:06.227Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=883e6e5a-64a1-4cec-ac13-3213bde9ed30 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:54:06.227326Z InvocationID=4277119a-9b28-4987-802e-d29ecd5c58bc LogTimestamp=2021-04-14T12:54:06.227365Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:54:06.228Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:54:06.227Z InvocationID=58e1522a-2dad-4e4e-bf27-3fc4eb4299cc LogTimestamp=2021-04-14T12:54:06.228657Z ResponseDesc=OK Exiting. 2021-04-14T12:54:06.229Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:54:09.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff8ecf6c-5f25-40ca-b5c9-6f10efc511e0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:09.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff8ecf6c-5f25-40ca-b5c9-6f10efc511e0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4cb2278b 2021-04-14T12:54:09.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff8ecf6c-5f25-40ca-b5c9-6f10efc511e0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:09.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff8ecf6c-5f25-40ca-b5c9-6f10efc511e0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df7b5bc6-a796-4b29-b375-f0f63191299e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df7b5bc6-a796-4b29-b375-f0f63191299e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d1493b3 2021-04-14T12:54:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df7b5bc6-a796-4b29-b375-f0f63191299e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:12.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=df7b5bc6-a796-4b29-b375-f0f63191299e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16a972c-2e94-4856-b7e7-3c43d0f6c5c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16a972c-2e94-4856-b7e7-3c43d0f6c5c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65ab5b9b 2021-04-14T12:54:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16a972c-2e94-4856-b7e7-3c43d0f6c5c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e16a972c-2e94-4856-b7e7-3c43d0f6c5c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:18.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89651dd8-fad1-4a1c-9fdf-4cf1d11f5527 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:18.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89651dd8-fad1-4a1c-9fdf-4cf1d11f5527 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@527167c1 2021-04-14T12:54:18.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89651dd8-fad1-4a1c-9fdf-4cf1d11f5527 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:18.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89651dd8-fad1-4a1c-9fdf-4cf1d11f5527 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f15eb34-22f7-4b42-af3e-3b6d0da060b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f15eb34-22f7-4b42-af3e-3b6d0da060b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fa29c7b 2021-04-14T12:54:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f15eb34-22f7-4b42-af3e-3b6d0da060b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f15eb34-22f7-4b42-af3e-3b6d0da060b1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e6233f-c5ff-4c93-b7c8-f8a1e0575074 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e6233f-c5ff-4c93-b7c8-f8a1e0575074 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16b21f37 2021-04-14T12:54:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e6233f-c5ff-4c93-b7c8-f8a1e0575074 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3e6233f-c5ff-4c93-b7c8-f8a1e0575074 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:27.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebeb500d-ad79-4491-8dce-9ab21271c547 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:27.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebeb500d-ad79-4491-8dce-9ab21271c547 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@297af9f9 2021-04-14T12:54:27.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebeb500d-ad79-4491-8dce-9ab21271c547 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:27.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebeb500d-ad79-4491-8dce-9ab21271c547 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61e9b29a-5480-4827-aa99-8c4d85b5cb8b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61e9b29a-5480-4827-aa99-8c4d85b5cb8b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70ecdc78 2021-04-14T12:54:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61e9b29a-5480-4827-aa99-8c4d85b5cb8b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61e9b29a-5480-4827-aa99-8c4d85b5cb8b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:33.238Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a6faf9-13b6-4ef6-8968-74732c832b57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a6faf9-13b6-4ef6-8968-74732c832b57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bb6c75a 2021-04-14T12:54:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a6faf9-13b6-4ef6-8968-74732c832b57 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:33.239Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8a6faf9-13b6-4ef6-8968-74732c832b57 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6be6a71-c119-42ed-9691-7dee13517541 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6be6a71-c119-42ed-9691-7dee13517541 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dfb36bc 2021-04-14T12:54:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6be6a71-c119-42ed-9691-7dee13517541 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d6be6a71-c119-42ed-9691-7dee13517541 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:36.225Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6e13d80c-3b26-4ebe-bfd3-9c94063ec39e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:54:36.225475Z InvocationID=85e2443d-cff7-47d0-8969-2c39df8dcf34 LogTimestamp=2021-04-14T12:54:36.225529Z Entering 2021-04-14T12:54:36.226Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6e13d80c-3b26-4ebe-bfd3-9c94063ec39e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:54:36.225475Z InvocationID=85e2443d-cff7-47d0-8969-2c39df8dcf34 LogTimestamp=2021-04-14T12:54:36.225529Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:54:36.227Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:54:36.226Z InvocationID=06e12450-57f6-4a76-90f0-229eb51849a8 LogTimestamp=2021-04-14T12:54:36.227700Z ResponseDesc=OK Exiting. 2021-04-14T12:54:36.228Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:54:38.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dec431f-7715-450d-a8d2-739054949099 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:38.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dec431f-7715-450d-a8d2-739054949099 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13b0afcb 2021-04-14T12:54:38.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dec431f-7715-450d-a8d2-739054949099 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:38.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dec431f-7715-450d-a8d2-739054949099 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:41.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc879e94-22f0-43e9-9dc1-53cc656461ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:41.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc879e94-22f0-43e9-9dc1-53cc656461ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@529bed9 2021-04-14T12:54:41.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc879e94-22f0-43e9-9dc1-53cc656461ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:41.586Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc879e94-22f0-43e9-9dc1-53cc656461ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06ebbe0-4b8f-45bb-8e7c-7a0166c8956a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06ebbe0-4b8f-45bb-8e7c-7a0166c8956a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58f83531 2021-04-14T12:54:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06ebbe0-4b8f-45bb-8e7c-7a0166c8956a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c06ebbe0-4b8f-45bb-8e7c-7a0166c8956a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:46.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:54:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:54:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9c9719f-6f0a-4cf6-8c23-487aca9fb691 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9c9719f-6f0a-4cf6-8c23-487aca9fb691 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c82b644 2021-04-14T12:54:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9c9719f-6f0a-4cf6-8c23-487aca9fb691 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9c9719f-6f0a-4cf6-8c23-487aca9fb691 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dde2615-a653-4aac-8903-d83990b0332f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dde2615-a653-4aac-8903-d83990b0332f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ada92e8 2021-04-14T12:54:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dde2615-a653-4aac-8903-d83990b0332f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4dde2615-a653-4aac-8903-d83990b0332f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:54.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594896fa-e928-41fa-af26-dfdd7f140be8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:54.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594896fa-e928-41fa-af26-dfdd7f140be8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32cd341c 2021-04-14T12:54:54.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594896fa-e928-41fa-af26-dfdd7f140be8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:54.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=594896fa-e928-41fa-af26-dfdd7f140be8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9ebd225-b38b-4fef-a03c-51802008cdb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9ebd225-b38b-4fef-a03c-51802008cdb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b85cec9 2021-04-14T12:54:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9ebd225-b38b-4fef-a03c-51802008cdb4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9ebd225-b38b-4fef-a03c-51802008cdb4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:54:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31dec03e-5971-4115-b445-5b2bac528329 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:54:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31dec03e-5971-4115-b445-5b2bac528329 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@524c7d6b 2021-04-14T12:54:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31dec03e-5971-4115-b445-5b2bac528329 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:54:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31dec03e-5971-4115-b445-5b2bac528329 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:03.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b800c59-a018-4c53-9a3c-bd92b4d9e886 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:03.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b800c59-a018-4c53-9a3c-bd92b4d9e886 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cafe818 2021-04-14T12:55:03.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b800c59-a018-4c53-9a3c-bd92b4d9e886 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:03.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9b800c59-a018-4c53-9a3c-bd92b4d9e886 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:55:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:55:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:55:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:55:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:55:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:55:06.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24bf63ce-aa28-4bcf-a944-06460416bf02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:06.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24bf63ce-aa28-4bcf-a944-06460416bf02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27194e45 2021-04-14T12:55:06.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24bf63ce-aa28-4bcf-a944-06460416bf02 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:06.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24bf63ce-aa28-4bcf-a944-06460416bf02 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:06.237Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=06170513-e648-4449-bc11-d61e4246dfc7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:06.236863Z InvocationID=1f936459-e9c2-45f8-bcc7-402208f4d168 LogTimestamp=2021-04-14T12:55:06.236945Z Entering 2021-04-14T12:55:06.237Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=06170513-e648-4449-bc11-d61e4246dfc7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:06.236863Z InvocationID=1f936459-e9c2-45f8-bcc7-402208f4d168 LogTimestamp=2021-04-14T12:55:06.236945Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:55:06.238Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:55:06.237Z InvocationID=61a6c513-a168-464c-a720-c438418f177a LogTimestamp=2021-04-14T12:55:06.238851Z ResponseDesc=OK Exiting. 2021-04-14T12:55:06.239Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:55:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e04b5e5f-36d8-4ac2-bfb9-0148d4e119e6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e04b5e5f-36d8-4ac2-bfb9-0148d4e119e6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@226f3fe9 2021-04-14T12:55:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e04b5e5f-36d8-4ac2-bfb9-0148d4e119e6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e04b5e5f-36d8-4ac2-bfb9-0148d4e119e6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bae833d6-416e-43f3-9514-731e241df04a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bae833d6-416e-43f3-9514-731e241df04a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13f9a9ea 2021-04-14T12:55:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bae833d6-416e-43f3-9514-731e241df04a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bae833d6-416e-43f3-9514-731e241df04a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:14.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d39d53-350d-41f4-840e-29b2f3294f56 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:14.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d39d53-350d-41f4-840e-29b2f3294f56 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@10957ca5 2021-04-14T12:55:14.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d39d53-350d-41f4-840e-29b2f3294f56 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:14.614Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6d39d53-350d-41f4-840e-29b2f3294f56 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e620b0-f5f9-4a85-b79f-21ce7eb6c68a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e620b0-f5f9-4a85-b79f-21ce7eb6c68a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d137394 2021-04-14T12:55:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e620b0-f5f9-4a85-b79f-21ce7eb6c68a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:17.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2e620b0-f5f9-4a85-b79f-21ce7eb6c68a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f125b0ac-0d12-42f2-af7f-0b1efaf22e39 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f125b0ac-0d12-42f2-af7f-0b1efaf22e39 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26588ba8 2021-04-14T12:55:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f125b0ac-0d12-42f2-af7f-0b1efaf22e39 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:20.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f125b0ac-0d12-42f2-af7f-0b1efaf22e39 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8c32335-3417-4d95-afe1-bd4cf8c18e16 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8c32335-3417-4d95-afe1-bd4cf8c18e16 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78b0c070 2021-04-14T12:55:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8c32335-3417-4d95-afe1-bd4cf8c18e16 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:23.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8c32335-3417-4d95-afe1-bd4cf8c18e16 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:27.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f943bc1-422a-469d-b3d2-81e9f8d4b6e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:27.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f943bc1-422a-469d-b3d2-81e9f8d4b6e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@437beb97 2021-04-14T12:55:27.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f943bc1-422a-469d-b3d2-81e9f8d4b6e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:27.007Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f943bc1-422a-469d-b3d2-81e9f8d4b6e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23dca3ec-368a-422a-8e35-381f63f4a681 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23dca3ec-368a-422a-8e35-381f63f4a681 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2592afbf 2021-04-14T12:55:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23dca3ec-368a-422a-8e35-381f63f4a681 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:30.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23dca3ec-368a-422a-8e35-381f63f4a681 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:33.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56027012-05ea-4a40-9408-d58d66e1bd3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:33.220Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56027012-05ea-4a40-9408-d58d66e1bd3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4775756e 2021-04-14T12:55:33.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56027012-05ea-4a40-9408-d58d66e1bd3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:33.221Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56027012-05ea-4a40-9408-d58d66e1bd3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:34.967Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bde3dd37-0547-4c17-b8b9-c6801a222ace InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:34.966544Z InvocationID=c741df13-28e8-43d8-9643-5b7df60107ee LogTimestamp=2021-04-14T12:55:34.966661Z Entering 2021-04-14T12:55:34.967Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bde3dd37-0547-4c17-b8b9-c6801a222ace InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:34.966544Z InvocationID=c741df13-28e8-43d8-9643-5b7df60107ee LogTimestamp=2021-04-14T12:55:34.966661Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:55:34.971Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=4 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:55:34.967Z InvocationID=8b6cad3a-36ac-4bcc-af56-bb52bf16ebfb LogTimestamp=2021-04-14T12:55:34.971711Z ResponseDesc=OK Exiting. 2021-04-14T12:55:34.972Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:55:36.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01ea283b-72c5-4cb2-8860-77eeac9a822e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:36.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01ea283b-72c5-4cb2-8860-77eeac9a822e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39388eb0 2021-04-14T12:55:36.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01ea283b-72c5-4cb2-8860-77eeac9a822e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:36.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01ea283b-72c5-4cb2-8860-77eeac9a822e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:36.242Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0679dba7-e2f4-4518-ad71-3cd8af522d96 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:36.242034Z InvocationID=689f1585-bfc8-42ba-bb32-54b9ff432a2d LogTimestamp=2021-04-14T12:55:36.242090Z Entering 2021-04-14T12:55:36.242Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0679dba7-e2f4-4518-ad71-3cd8af522d96 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:36.242034Z InvocationID=689f1585-bfc8-42ba-bb32-54b9ff432a2d LogTimestamp=2021-04-14T12:55:36.242090Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:55:36.243Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:55:36.242Z InvocationID=8b68d90d-a8b6-45a2-af30-87be7a882940 LogTimestamp=2021-04-14T12:55:36.243767Z ResponseDesc=OK Exiting. 2021-04-14T12:55:36.244Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:55:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41e64c5a-317f-4e46-8fc6-201b2fd0b68d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41e64c5a-317f-4e46-8fc6-201b2fd0b68d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2503ed53 2021-04-14T12:55:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41e64c5a-317f-4e46-8fc6-201b2fd0b68d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41e64c5a-317f-4e46-8fc6-201b2fd0b68d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b065d126-4a24-4af2-b4a7-c53c9820f648 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b065d126-4a24-4af2-b4a7-c53c9820f648 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15dc411b 2021-04-14T12:55:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b065d126-4a24-4af2-b4a7-c53c9820f648 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b065d126-4a24-4af2-b4a7-c53c9820f648 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:44.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1946be0-e060-48dd-9bb3-b3bd56f3e019 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:44.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1946be0-e060-48dd-9bb3-b3bd56f3e019 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79ee88cb 2021-04-14T12:55:44.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1946be0-e060-48dd-9bb3-b3bd56f3e019 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:44.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1946be0-e060-48dd-9bb3-b3bd56f3e019 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:46.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:55:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:55:47.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b771b20d-29a2-4fda-9101-9a5355b3bd6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b771b20d-29a2-4fda-9101-9a5355b3bd6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dec448 2021-04-14T12:55:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b771b20d-29a2-4fda-9101-9a5355b3bd6b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b771b20d-29a2-4fda-9101-9a5355b3bd6b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:48.234Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fc006d6b-1b3d-4fb3-a38b-cd4c3974814e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:48.233822Z InvocationID=a884bfc7-59a3-49b9-b8d1-d43e1ade64ce LogTimestamp=2021-04-14T12:55:48.233879Z Entering 2021-04-14T12:55:48.234Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fc006d6b-1b3d-4fb3-a38b-cd4c3974814e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:55:48.233822Z InvocationID=a884bfc7-59a3-49b9-b8d1-d43e1ade64ce LogTimestamp=2021-04-14T12:55:48.233879Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:55:48.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:55:48.234Z InvocationID=ed8b24d0-deb3-4aee-8172-b3ce0873b44e LogTimestamp=2021-04-14T12:55:48.235220Z ResponseDesc=OK Exiting. 2021-04-14T12:55:48.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:55:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26170a40-6579-4f27-a3aa-1df16f2584aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26170a40-6579-4f27-a3aa-1df16f2584aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e0dd8f5 2021-04-14T12:55:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26170a40-6579-4f27-a3aa-1df16f2584aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:51.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=26170a40-6579-4f27-a3aa-1df16f2584aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=950f8ee5-f3b8-4c63-8284-e04eb85f7e71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=950f8ee5-f3b8-4c63-8284-e04eb85f7e71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49ae82b6 2021-04-14T12:55:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=950f8ee5-f3b8-4c63-8284-e04eb85f7e71 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=950f8ee5-f3b8-4c63-8284-e04eb85f7e71 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3da1462-6759-450e-a944-4fe5cd6bbbf8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3da1462-6759-450e-a944-4fe5cd6bbbf8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@440be398 2021-04-14T12:55:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3da1462-6759-450e-a944-4fe5cd6bbbf8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:56.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3da1462-6759-450e-a944-4fe5cd6bbbf8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:55:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06cb1a-5120-488c-9a38-42abaaee3a72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:55:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06cb1a-5120-488c-9a38-42abaaee3a72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@360583d5 2021-04-14T12:55:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06cb1a-5120-488c-9a38-42abaaee3a72 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:55:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d06cb1a-5120-488c-9a38-42abaaee3a72 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:03.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b03459d-a9e4-4678-8f83-93a4e50d1ac2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b03459d-a9e4-4678-8f83-93a4e50d1ac2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@661f3f90 2021-04-14T12:56:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b03459d-a9e4-4678-8f83-93a4e50d1ac2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:03.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b03459d-a9e4-4678-8f83-93a4e50d1ac2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:56:04.354Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:56:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:56:04.355Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:56:04.357Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:56:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:56:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e188b443-592b-4d82-b61f-bb6b33d9ebc9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e188b443-592b-4d82-b61f-bb6b33d9ebc9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b19aad7 2021-04-14T12:56:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e188b443-592b-4d82-b61f-bb6b33d9ebc9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e188b443-592b-4d82-b61f-bb6b33d9ebc9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:06.248Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=19d4f904-6870-461d-83a0-c61c14733213 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:56:06.248653Z InvocationID=3bc31ef6-ef12-4fd2-9b9c-24b5e2dcb94f LogTimestamp=2021-04-14T12:56:06.248710Z Entering 2021-04-14T12:56:06.249Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=19d4f904-6870-461d-83a0-c61c14733213 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:56:06.248653Z InvocationID=3bc31ef6-ef12-4fd2-9b9c-24b5e2dcb94f LogTimestamp=2021-04-14T12:56:06.248710Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:56:06.250Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:56:06.249Z InvocationID=e6547977-49f7-4139-9037-dc31e4f65671 LogTimestamp=2021-04-14T12:56:06.250592Z ResponseDesc=OK Exiting. 2021-04-14T12:56:06.250Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:56:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc945e0a-17be-4afd-a27b-67a3e3d95be6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc945e0a-17be-4afd-a27b-67a3e3d95be6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4095950f 2021-04-14T12:56:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc945e0a-17be-4afd-a27b-67a3e3d95be6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:08.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc945e0a-17be-4afd-a27b-67a3e3d95be6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba096e5-143c-4f9a-98e0-6dc98b6f627f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba096e5-143c-4f9a-98e0-6dc98b6f627f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a94bde3 2021-04-14T12:56:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba096e5-143c-4f9a-98e0-6dc98b6f627f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:12.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dba096e5-143c-4f9a-98e0-6dc98b6f627f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:14.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=747f4c40-e124-4ad8-99c5-781582aaa178 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:14.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=747f4c40-e124-4ad8-99c5-781582aaa178 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4568fa9e 2021-04-14T12:56:14.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=747f4c40-e124-4ad8-99c5-781582aaa178 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:14.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=747f4c40-e124-4ad8-99c5-781582aaa178 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:18.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b6ae54-e39f-4790-9c17-5d7e3c38a26d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:18.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b6ae54-e39f-4790-9c17-5d7e3c38a26d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53b1bff6 2021-04-14T12:56:18.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b6ae54-e39f-4790-9c17-5d7e3c38a26d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:18.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98b6ae54-e39f-4790-9c17-5d7e3c38a26d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:20.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b376c561-00a7-4dfb-920c-049b645e7bd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:20.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b376c561-00a7-4dfb-920c-049b645e7bd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fe06562 2021-04-14T12:56:20.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b376c561-00a7-4dfb-920c-049b645e7bd0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:20.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b376c561-00a7-4dfb-920c-049b645e7bd0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7987c720-f4af-425b-bb6a-f8c33e67e0fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7987c720-f4af-425b-bb6a-f8c33e67e0fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40e4bcd8 2021-04-14T12:56:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7987c720-f4af-425b-bb6a-f8c33e67e0fd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7987c720-f4af-425b-bb6a-f8c33e67e0fd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:27.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd764903-bb92-4c9c-b4d6-c4a53ec7056b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:27.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd764903-bb92-4c9c-b4d6-c4a53ec7056b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42da0250 2021-04-14T12:56:27.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd764903-bb92-4c9c-b4d6-c4a53ec7056b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:27.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd764903-bb92-4c9c-b4d6-c4a53ec7056b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:29.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f0d83d9-b69a-41d8-9c27-92b1e8a5342e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:29.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f0d83d9-b69a-41d8-9c27-92b1e8a5342e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c4a5bf2 2021-04-14T12:56:29.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f0d83d9-b69a-41d8-9c27-92b1e8a5342e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:29.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f0d83d9-b69a-41d8-9c27-92b1e8a5342e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a520a4-4e6f-42a6-a22d-d1fc6ef9ee4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a520a4-4e6f-42a6-a22d-d1fc6ef9ee4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20bde66c 2021-04-14T12:56:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a520a4-4e6f-42a6-a22d-d1fc6ef9ee4b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95a520a4-4e6f-42a6-a22d-d1fc6ef9ee4b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:35.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56ff7f2a-36d5-4df2-b59c-1904aaba875c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:35.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56ff7f2a-36d5-4df2-b59c-1904aaba875c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45da9cdf 2021-04-14T12:56:35.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56ff7f2a-36d5-4df2-b59c-1904aaba875c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:35.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56ff7f2a-36d5-4df2-b59c-1904aaba875c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:36.236Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=067a16c5-8b06-42f3-9c2d-6e25e29dae78 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:56:36.235847Z InvocationID=ad1e9681-ce0d-467d-b578-db7e498a1c86 LogTimestamp=2021-04-14T12:56:36.235902Z Entering 2021-04-14T12:56:36.236Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=067a16c5-8b06-42f3-9c2d-6e25e29dae78 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:56:36.235847Z InvocationID=ad1e9681-ce0d-467d-b578-db7e498a1c86 LogTimestamp=2021-04-14T12:56:36.235902Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:56:36.237Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:56:36.236Z InvocationID=694ffc36-9697-47e7-a349-00908405163b LogTimestamp=2021-04-14T12:56:36.237408Z ResponseDesc=OK Exiting. 2021-04-14T12:56:36.237Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:56:38.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3c1205-0e3e-4bb9-9c3a-0d39ad297bd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:38.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3c1205-0e3e-4bb9-9c3a-0d39ad297bd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5700deb6 2021-04-14T12:56:38.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3c1205-0e3e-4bb9-9c3a-0d39ad297bd5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:38.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd3c1205-0e3e-4bb9-9c3a-0d39ad297bd5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aba20cd-0149-4cdd-86b2-ed98a8404050 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aba20cd-0149-4cdd-86b2-ed98a8404050 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19db8a6f 2021-04-14T12:56:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aba20cd-0149-4cdd-86b2-ed98a8404050 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3aba20cd-0149-4cdd-86b2-ed98a8404050 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:44.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bc3e5e-ed19-4db8-8de5-13d00bae147d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:44.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bc3e5e-ed19-4db8-8de5-13d00bae147d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@569a81be 2021-04-14T12:56:44.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bc3e5e-ed19-4db8-8de5-13d00bae147d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:44.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5bc3e5e-ed19-4db8-8de5-13d00bae147d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:56:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:56:47.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a342c9d-652a-4b60-90c5-46deb25a3197 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a342c9d-652a-4b60-90c5-46deb25a3197 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4737c3d6 2021-04-14T12:56:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a342c9d-652a-4b60-90c5-46deb25a3197 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:47.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a342c9d-652a-4b60-90c5-46deb25a3197 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5799c6df-a7b0-4c04-87d8-a261f2b3b5b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5799c6df-a7b0-4c04-87d8-a261f2b3b5b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@169350e8 2021-04-14T12:56:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5799c6df-a7b0-4c04-87d8-a261f2b3b5b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5799c6df-a7b0-4c04-87d8-a261f2b3b5b8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:53.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c76cd2a-b214-4a32-b428-ba5c0741b099 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:53.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c76cd2a-b214-4a32-b428-ba5c0741b099 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53de28a7 2021-04-14T12:56:53.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c76cd2a-b214-4a32-b428-ba5c0741b099 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:53.827Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c76cd2a-b214-4a32-b428-ba5c0741b099 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8feab02-2de4-4c97-abab-f7ffdb9c86b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8feab02-2de4-4c97-abab-f7ffdb9c86b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@514bd413 2021-04-14T12:56:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8feab02-2de4-4c97-abab-f7ffdb9c86b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8feab02-2de4-4c97-abab-f7ffdb9c86b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:56:59.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=575566e6-a7de-4e39-aad4-df6470ad2834 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:56:59.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=575566e6-a7de-4e39-aad4-df6470ad2834 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@289b949f 2021-04-14T12:56:59.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=575566e6-a7de-4e39-aad4-df6470ad2834 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:56:59.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=575566e6-a7de-4e39-aad4-df6470ad2834 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:02.745Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ead875d-88b1-4157-a041-7868dc259411 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:02.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ead875d-88b1-4157-a041-7868dc259411 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24039574 2021-04-14T12:57:02.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ead875d-88b1-4157-a041-7868dc259411 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:02.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ead875d-88b1-4157-a041-7868dc259411 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:57:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:57:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:57:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:57:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:57:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:57:06.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b38345-3239-4797-b2d6-d0c5d0160333 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:06.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b38345-3239-4797-b2d6-d0c5d0160333 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ba0a43 2021-04-14T12:57:06.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b38345-3239-4797-b2d6-d0c5d0160333 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:06.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61b38345-3239-4797-b2d6-d0c5d0160333 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:06.242Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6255626f-ec96-493d-a784-6d2ff5d05ce6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:06.241465Z InvocationID=7347d4f2-68de-47f8-9d52-1b75df445448 LogTimestamp=2021-04-14T12:57:06.241614Z Entering 2021-04-14T12:57:06.242Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6255626f-ec96-493d-a784-6d2ff5d05ce6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:06.241465Z InvocationID=7347d4f2-68de-47f8-9d52-1b75df445448 LogTimestamp=2021-04-14T12:57:06.241614Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:57:06.246Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=4 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:57:06.242Z InvocationID=6cea3cfa-6429-4f40-930c-583dcadbc13f LogTimestamp=2021-04-14T12:57:06.246043Z ResponseDesc=OK Exiting. 2021-04-14T12:57:06.246Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:57:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb009937-7908-4add-9877-4f3224eaa925 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb009937-7908-4add-9877-4f3224eaa925 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9debdcb 2021-04-14T12:57:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb009937-7908-4add-9877-4f3224eaa925 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:09.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb009937-7908-4add-9877-4f3224eaa925 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac0c96e-1491-4272-a453-aff208414a3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac0c96e-1491-4272-a453-aff208414a3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d15ef03 2021-04-14T12:57:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac0c96e-1491-4272-a453-aff208414a3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:12.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7ac0c96e-1491-4272-a453-aff208414a3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:14.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=898d202a-24bc-4b13-bfd6-87526bb036ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:14.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=898d202a-24bc-4b13-bfd6-87526bb036ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45056de0 2021-04-14T12:57:14.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=898d202a-24bc-4b13-bfd6-87526bb036ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:14.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=898d202a-24bc-4b13-bfd6-87526bb036ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:17.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88353e41-155b-44fd-b0a0-8e9e47afc41e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:17.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88353e41-155b-44fd-b0a0-8e9e47afc41e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13bb9f11 2021-04-14T12:57:17.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88353e41-155b-44fd-b0a0-8e9e47afc41e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:17.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88353e41-155b-44fd-b0a0-8e9e47afc41e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7695927-f1c6-4441-bf8c-58662c05c7db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7695927-f1c6-4441-bf8c-58662c05c7db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f774848 2021-04-14T12:57:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7695927-f1c6-4441-bf8c-58662c05c7db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7695927-f1c6-4441-bf8c-58662c05c7db PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:24.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a579d00-6666-498e-a564-0fabcc6aef37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:24.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a579d00-6666-498e-a564-0fabcc6aef37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d48cf52 2021-04-14T12:57:24.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a579d00-6666-498e-a564-0fabcc6aef37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:24.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a579d00-6666-498e-a564-0fabcc6aef37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37be5d17-12f4-4e7f-b4a1-af1b257e2854 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37be5d17-12f4-4e7f-b4a1-af1b257e2854 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@534cdf76 2021-04-14T12:57:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37be5d17-12f4-4e7f-b4a1-af1b257e2854 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37be5d17-12f4-4e7f-b4a1-af1b257e2854 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:29.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e02aeaa-8754-436c-b7d2-760eaa183380 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:29.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e02aeaa-8754-436c-b7d2-760eaa183380 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cc09119 2021-04-14T12:57:29.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e02aeaa-8754-436c-b7d2-760eaa183380 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:29.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e02aeaa-8754-436c-b7d2-760eaa183380 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079f397-4561-4bc0-9663-08ade4d59f69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079f397-4561-4bc0-9663-08ade4d59f69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49a0afc1 2021-04-14T12:57:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079f397-4561-4bc0-9663-08ade4d59f69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6079f397-4561-4bc0-9663-08ade4d59f69 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:33.913Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=39888875-21ac-4006-ab4e-e7e8e6626521 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:33.913371Z InvocationID=9a2d0f6c-81bd-42df-95af-7511976d33c6 LogTimestamp=2021-04-14T12:57:33.913449Z Entering 2021-04-14T12:57:33.913Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=39888875-21ac-4006-ab4e-e7e8e6626521 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:33.913371Z InvocationID=9a2d0f6c-81bd-42df-95af-7511976d33c6 LogTimestamp=2021-04-14T12:57:33.913449Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:57:33.915Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:57:33.913Z InvocationID=7053b03e-4637-4a3a-8fa6-975c992bc856 LogTimestamp=2021-04-14T12:57:33.915442Z ResponseDesc=OK Exiting. 2021-04-14T12:57:33.915Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:57:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ec972-75f0-4dd6-876e-32ba1a801969 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ec972-75f0-4dd6-876e-32ba1a801969 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3269cbf8 2021-04-14T12:57:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ec972-75f0-4dd6-876e-32ba1a801969 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:35.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e7ec972-75f0-4dd6-876e-32ba1a801969 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:36.224Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=055ef0fb-f5ae-447e-9ff6-94623440add3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:36.224433Z InvocationID=76945abc-9080-42c5-8922-f9a92f989a92 LogTimestamp=2021-04-14T12:57:36.224458Z Entering 2021-04-14T12:57:36.224Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=055ef0fb-f5ae-447e-9ff6-94623440add3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:36.224433Z InvocationID=76945abc-9080-42c5-8922-f9a92f989a92 LogTimestamp=2021-04-14T12:57:36.224458Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:57:36.225Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:57:36.224Z InvocationID=a09a6a7b-d03f-460c-b38b-a91ed0dfc44e LogTimestamp=2021-04-14T12:57:36.225743Z ResponseDesc=OK Exiting. 2021-04-14T12:57:36.225Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:57:39.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bb9658f-d842-4c80-870a-6f5b2e966692 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:39.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bb9658f-d842-4c80-870a-6f5b2e966692 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76b05ac 2021-04-14T12:57:39.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bb9658f-d842-4c80-870a-6f5b2e966692 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:39.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3bb9658f-d842-4c80-870a-6f5b2e966692 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34784c4d-3c62-40b3-a826-fda517bb1e03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34784c4d-3c62-40b3-a826-fda517bb1e03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f3b1401 2021-04-14T12:57:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34784c4d-3c62-40b3-a826-fda517bb1e03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34784c4d-3c62-40b3-a826-fda517bb1e03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:45.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beaa013-1433-49c1-b426-0acf8e0aae5b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:45.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beaa013-1433-49c1-b426-0acf8e0aae5b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53a96e80 2021-04-14T12:57:45.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beaa013-1433-49c1-b426-0acf8e0aae5b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:45.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3beaa013-1433-49c1-b426-0acf8e0aae5b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:57:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:57:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f613d49-2be1-44e4-a73c-a6eb39cf04ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f613d49-2be1-44e4-a73c-a6eb39cf04ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f635906 2021-04-14T12:57:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f613d49-2be1-44e4-a73c-a6eb39cf04ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f613d49-2be1-44e4-a73c-a6eb39cf04ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:48.219Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3ff56d12-2f07-448e-8acc-dc20a89fc135 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:48.219297Z InvocationID=76344455-4e1a-4ee9-a79e-de63b575f1c3 LogTimestamp=2021-04-14T12:57:48.219355Z Entering 2021-04-14T12:57:48.219Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3ff56d12-2f07-448e-8acc-dc20a89fc135 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:57:48.219297Z InvocationID=76344455-4e1a-4ee9-a79e-de63b575f1c3 LogTimestamp=2021-04-14T12:57:48.219355Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:57:48.221Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:57:48.219Z InvocationID=7605d961-00f1-4948-bc5d-e7efdf079549 LogTimestamp=2021-04-14T12:57:48.221138Z ResponseDesc=OK Exiting. 2021-04-14T12:57:48.221Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:57:51.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0296b481-cdbb-4f42-8220-58fdbfa9f26c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:51.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0296b481-cdbb-4f42-8220-58fdbfa9f26c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@707a6f23 2021-04-14T12:57:51.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0296b481-cdbb-4f42-8220-58fdbfa9f26c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:51.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0296b481-cdbb-4f42-8220-58fdbfa9f26c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dd6ca0-015a-44e5-962b-6add8f81e826 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dd6ca0-015a-44e5-962b-6add8f81e826 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3726f631 2021-04-14T12:57:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dd6ca0-015a-44e5-962b-6add8f81e826 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dd6ca0-015a-44e5-962b-6add8f81e826 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:56.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faa843a4-ee1a-4265-8516-e59fd2bc4051 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:56.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faa843a4-ee1a-4265-8516-e59fd2bc4051 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fe3433b 2021-04-14T12:57:56.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faa843a4-ee1a-4265-8516-e59fd2bc4051 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:56.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faa843a4-ee1a-4265-8516-e59fd2bc4051 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:57:59.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c052574d-6152-443a-947c-fe5b72d0e6ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:57:59.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c052574d-6152-443a-947c-fe5b72d0e6ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1afd84a8 2021-04-14T12:57:59.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c052574d-6152-443a-947c-fe5b72d0e6ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:57:59.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c052574d-6152-443a-947c-fe5b72d0e6ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018ca50c-09c7-4493-aa48-b1ae901b92f3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018ca50c-09c7-4493-aa48-b1ae901b92f3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39dde3a3 2021-04-14T12:58:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018ca50c-09c7-4493-aa48-b1ae901b92f3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:02.728Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=018ca50c-09c7-4493-aa48-b1ae901b92f3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:58:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:58:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:58:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:58:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:58:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:58:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f09629-1cc5-42c2-8d44-4df44bedffa2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f09629-1cc5-42c2-8d44-4df44bedffa2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@394a1dd7 2021-04-14T12:58:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f09629-1cc5-42c2-8d44-4df44bedffa2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6f09629-1cc5-42c2-8d44-4df44bedffa2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:06.341Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=798f9eac-53b1-4619-b55a-b66645a61cc5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:58:06.340640Z InvocationID=32ced2f0-ab69-4bac-a642-110b3c0e4963 LogTimestamp=2021-04-14T12:58:06.340719Z Entering 2021-04-14T12:58:06.341Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=798f9eac-53b1-4619-b55a-b66645a61cc5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:58:06.340640Z InvocationID=32ced2f0-ab69-4bac-a642-110b3c0e4963 LogTimestamp=2021-04-14T12:58:06.340719Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:58:06.343Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:58:06.341Z InvocationID=e09e0821-8dc4-4bce-bd9b-8b4f0d3ec128 LogTimestamp=2021-04-14T12:58:06.343371Z ResponseDesc=OK Exiting. 2021-04-14T12:58:06.343Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:58:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62a9697e-4b32-4430-afa7-27687bd1a85c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62a9697e-4b32-4430-afa7-27687bd1a85c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c856b5e 2021-04-14T12:58:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62a9697e-4b32-4430-afa7-27687bd1a85c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62a9697e-4b32-4430-afa7-27687bd1a85c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fc564f-1010-4ed0-abcf-ccd8e8cb92d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fc564f-1010-4ed0-abcf-ccd8e8cb92d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a2b66a2 2021-04-14T12:58:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fc564f-1010-4ed0-abcf-ccd8e8cb92d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fc564f-1010-4ed0-abcf-ccd8e8cb92d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1de6f79-9489-499f-8dba-b84a2c8691da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1de6f79-9489-499f-8dba-b84a2c8691da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cbd42bf 2021-04-14T12:58:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1de6f79-9489-499f-8dba-b84a2c8691da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:14.693Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1de6f79-9489-499f-8dba-b84a2c8691da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:18.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326e7a7f-2e1d-4053-9619-6b42977faa28 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:18.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326e7a7f-2e1d-4053-9619-6b42977faa28 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45f0565a 2021-04-14T12:58:18.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326e7a7f-2e1d-4053-9619-6b42977faa28 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:18.241Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=326e7a7f-2e1d-4053-9619-6b42977faa28 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:20.767Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f212af9d-6291-46b3-a540-7e821e2cd5d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:20.768Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f212af9d-6291-46b3-a540-7e821e2cd5d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62881a21 2021-04-14T12:58:20.768Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f212af9d-6291-46b3-a540-7e821e2cd5d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:20.768Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f212af9d-6291-46b3-a540-7e821e2cd5d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a4fc1c1-2f59-48d9-9f39-8cb085b14e13 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a4fc1c1-2f59-48d9-9f39-8cb085b14e13 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43376ea4 2021-04-14T12:58:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a4fc1c1-2f59-48d9-9f39-8cb085b14e13 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a4fc1c1-2f59-48d9-9f39-8cb085b14e13 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fca87e8-2f21-471b-8748-3fc0d6c196c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fca87e8-2f21-471b-8748-3fc0d6c196c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d974c7 2021-04-14T12:58:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fca87e8-2f21-471b-8748-3fc0d6c196c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fca87e8-2f21-471b-8748-3fc0d6c196c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573fac55-7252-4ba2-b855-e2cc4f351857 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573fac55-7252-4ba2-b855-e2cc4f351857 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@425cb0a0 2021-04-14T12:58:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573fac55-7252-4ba2-b855-e2cc4f351857 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=573fac55-7252-4ba2-b855-e2cc4f351857 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:33.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=845e44ad-9137-4eab-9926-a86df7e102cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:33.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=845e44ad-9137-4eab-9926-a86df7e102cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60a7e3d8 2021-04-14T12:58:33.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=845e44ad-9137-4eab-9926-a86df7e102cd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:33.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=845e44ad-9137-4eab-9926-a86df7e102cd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b913bd-5722-4212-b2ab-0215551867aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b913bd-5722-4212-b2ab-0215551867aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@181de326 2021-04-14T12:58:35.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b913bd-5722-4212-b2ab-0215551867aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:35.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88b913bd-5722-4212-b2ab-0215551867aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:36.230Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a0c0e668-75d7-48aa-b418-867d001b5bf7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:58:36.229950Z InvocationID=28b74c5c-4ed0-4c07-a561-fd6d07b57745 LogTimestamp=2021-04-14T12:58:36.230016Z Entering 2021-04-14T12:58:36.230Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a0c0e668-75d7-48aa-b418-867d001b5bf7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:58:36.229950Z InvocationID=28b74c5c-4ed0-4c07-a561-fd6d07b57745 LogTimestamp=2021-04-14T12:58:36.230016Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:58:36.232Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:58:36.230Z InvocationID=d7da42d2-d474-484d-9bc1-bc029fac8110 LogTimestamp=2021-04-14T12:58:36.232165Z ResponseDesc=OK Exiting. 2021-04-14T12:58:36.232Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:58:39.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49d934c0-80f1-404b-a9b1-3df3b150ee88 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:39.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49d934c0-80f1-404b-a9b1-3df3b150ee88 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56acc3ae 2021-04-14T12:58:39.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49d934c0-80f1-404b-a9b1-3df3b150ee88 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:39.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49d934c0-80f1-404b-a9b1-3df3b150ee88 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab5db2b-bd28-494f-b849-ec8ecf3320ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab5db2b-bd28-494f-b849-ec8ecf3320ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7152a06b 2021-04-14T12:58:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab5db2b-bd28-494f-b849-ec8ecf3320ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:41.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dab5db2b-bd28-494f-b849-ec8ecf3320ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=619737dd-c4ee-4a42-a0e6-b0b36d26e25f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=619737dd-c4ee-4a42-a0e6-b0b36d26e25f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2eb434ba 2021-04-14T12:58:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=619737dd-c4ee-4a42-a0e6-b0b36d26e25f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:45.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=619737dd-c4ee-4a42-a0e6-b0b36d26e25f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:58:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:58:48.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e37fc6-0441-43dc-8447-4cbea66929b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:48.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e37fc6-0441-43dc-8447-4cbea66929b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59c7e699 2021-04-14T12:58:48.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e37fc6-0441-43dc-8447-4cbea66929b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:48.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3e37fc6-0441-43dc-8447-4cbea66929b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe116cd-9d0e-4e34-b442-87d8105cb748 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe116cd-9d0e-4e34-b442-87d8105cb748 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6946efbc 2021-04-14T12:58:51.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe116cd-9d0e-4e34-b442-87d8105cb748 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:51.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbe116cd-9d0e-4e34-b442-87d8105cb748 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67880d35-7ca0-4921-82e0-d0868b03d1ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67880d35-7ca0-4921-82e0-d0868b03d1ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@df34b07 2021-04-14T12:58:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67880d35-7ca0-4921-82e0-d0868b03d1ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:53.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=67880d35-7ca0-4921-82e0-d0868b03d1ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:57.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec16f454-2a31-4619-a002-6f98f7e2f69d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:57.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec16f454-2a31-4619-a002-6f98f7e2f69d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26dafe7 2021-04-14T12:58:57.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec16f454-2a31-4619-a002-6f98f7e2f69d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:57.047Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec16f454-2a31-4619-a002-6f98f7e2f69d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:58:59.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aa4cb81-0014-4759-bc63-3056524e74aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:58:59.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aa4cb81-0014-4759-bc63-3056524e74aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64f8721d 2021-04-14T12:58:59.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aa4cb81-0014-4759-bc63-3056524e74aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:58:59.598Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aa4cb81-0014-4759-bc63-3056524e74aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b98d967-7695-4e2f-8c01-3b8647ac3fb2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b98d967-7695-4e2f-8c01-3b8647ac3fb2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a9d4a31 2021-04-14T12:59:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b98d967-7695-4e2f-8c01-3b8647ac3fb2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:03.026Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b98d967-7695-4e2f-8c01-3b8647ac3fb2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T12:59:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T12:59:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T12:59:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T12:59:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T12:59:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T12:59:06.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08754dbe-51fb-4e43-b832-4350291bdc17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:06.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08754dbe-51fb-4e43-b832-4350291bdc17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d219516 2021-04-14T12:59:06.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08754dbe-51fb-4e43-b832-4350291bdc17 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:06.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08754dbe-51fb-4e43-b832-4350291bdc17 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:06.239Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f82d7444-77cf-4814-af25-bf2556b7077c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:06.239089Z InvocationID=99f1704b-6d81-4511-8fad-8bd549068183 LogTimestamp=2021-04-14T12:59:06.239149Z Entering 2021-04-14T12:59:06.239Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f82d7444-77cf-4814-af25-bf2556b7077c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:06.239089Z InvocationID=99f1704b-6d81-4511-8fad-8bd549068183 LogTimestamp=2021-04-14T12:59:06.239149Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:59:06.240Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:59:06.239Z InvocationID=8ccb3de8-c851-4f50-9130-16401a6bec5f LogTimestamp=2021-04-14T12:59:06.240397Z ResponseDesc=OK Exiting. 2021-04-14T12:59:06.240Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:59:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92519cb-7a45-4c9d-b6ed-2a2ad9c2756c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:08.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92519cb-7a45-4c9d-b6ed-2a2ad9c2756c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@425c15c2 2021-04-14T12:59:08.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92519cb-7a45-4c9d-b6ed-2a2ad9c2756c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:08.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f92519cb-7a45-4c9d-b6ed-2a2ad9c2756c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2014e3a0-7c66-4a4d-ae26-eb14235bc290 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2014e3a0-7c66-4a4d-ae26-eb14235bc290 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6593ef0e 2021-04-14T12:59:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2014e3a0-7c66-4a4d-ae26-eb14235bc290 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2014e3a0-7c66-4a4d-ae26-eb14235bc290 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a50bb2-5f77-43b6-b28d-e6b7e0de74b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a50bb2-5f77-43b6-b28d-e6b7e0de74b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@358ffd4f 2021-04-14T12:59:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a50bb2-5f77-43b6-b28d-e6b7e0de74b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41a50bb2-5f77-43b6-b28d-e6b7e0de74b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:17.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989c4135-3cdf-4fe4-b9a1-af9b7d006b0e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:17.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989c4135-3cdf-4fe4-b9a1-af9b7d006b0e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@142757cd 2021-04-14T12:59:17.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989c4135-3cdf-4fe4-b9a1-af9b7d006b0e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:17.990Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989c4135-3cdf-4fe4-b9a1-af9b7d006b0e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c178017-ba47-4bd4-babb-d0d454751448 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c178017-ba47-4bd4-babb-d0d454751448 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3677a28e 2021-04-14T12:59:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c178017-ba47-4bd4-babb-d0d454751448 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:20.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c178017-ba47-4bd4-babb-d0d454751448 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:24.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d9d9fc-8c0b-484e-9065-57156796ef77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:24.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d9d9fc-8c0b-484e-9065-57156796ef77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ce6c0d1 2021-04-14T12:59:24.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d9d9fc-8c0b-484e-9065-57156796ef77 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:24.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19d9d9fc-8c0b-484e-9065-57156796ef77 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e742c61b-0e4d-4552-b092-7de69614d6a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e742c61b-0e4d-4552-b092-7de69614d6a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c93987 2021-04-14T12:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e742c61b-0e4d-4552-b092-7de69614d6a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e742c61b-0e4d-4552-b092-7de69614d6a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fff9091c-4340-4c09-8df5-035b06ba3109 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fff9091c-4340-4c09-8df5-035b06ba3109 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@287e8fac 2021-04-14T12:59:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fff9091c-4340-4c09-8df5-035b06ba3109 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fff9091c-4340-4c09-8df5-035b06ba3109 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:31.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2901d030-855c-4d7d-9f6b-605a34a552b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2901d030-855c-4d7d-9f6b-605a34a552b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23162bff 2021-04-14T12:59:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2901d030-855c-4d7d-9f6b-605a34a552b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:33.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2901d030-855c-4d7d-9f6b-605a34a552b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:35.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f81e497-aac1-4b67-9f66-9fcbcaab27a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:35.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f81e497-aac1-4b67-9f66-9fcbcaab27a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@590c9704 2021-04-14T12:59:35.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f81e497-aac1-4b67-9f66-9fcbcaab27a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:35.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8f81e497-aac1-4b67-9f66-9fcbcaab27a3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:36.238Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8e37826a-5c77-4212-a617-3c8bd8545e74 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:36.237911Z InvocationID=5a9c7208-d5fe-404f-93d8-de3fe44c2125 LogTimestamp=2021-04-14T12:59:36.238188Z Entering 2021-04-14T12:59:36.239Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8e37826a-5c77-4212-a617-3c8bd8545e74 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:36.237911Z InvocationID=5a9c7208-d5fe-404f-93d8-de3fe44c2125 LogTimestamp=2021-04-14T12:59:36.238188Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:59:36.242Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:59:36.239Z InvocationID=e809c363-a2ea-4e88-8d43-b10cc8d6a2e7 LogTimestamp=2021-04-14T12:59:36.242684Z ResponseDesc=OK Exiting. 2021-04-14T12:59:36.243Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:59:39.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e4087-fab6-4f0e-9c0a-797758f18117 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:39.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e4087-fab6-4f0e-9c0a-797758f18117 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16c698a3 2021-04-14T12:59:39.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e4087-fab6-4f0e-9c0a-797758f18117 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:39.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f90e4087-fab6-4f0e-9c0a-797758f18117 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23bc6d73-16b3-4054-a3f0-7e9fe942aacf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23bc6d73-16b3-4054-a3f0-7e9fe942aacf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a996638 2021-04-14T12:59:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23bc6d73-16b3-4054-a3f0-7e9fe942aacf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=23bc6d73-16b3-4054-a3f0-7e9fe942aacf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:43.521Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=dea49751-31fa-45c0-ac89-892fdada90f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:43.521411Z InvocationID=33743115-7bcb-4285-8b6a-a931983fbffc LogTimestamp=2021-04-14T12:59:43.521467Z Entering 2021-04-14T12:59:43.521Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=dea49751-31fa-45c0-ac89-892fdada90f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:43.521411Z InvocationID=33743115-7bcb-4285-8b6a-a931983fbffc LogTimestamp=2021-04-14T12:59:43.521467Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:59:43.523Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:59:43.521Z InvocationID=54d82d8f-480d-45bd-a61b-270edcf041b3 LogTimestamp=2021-04-14T12:59:43.523790Z ResponseDesc=OK Exiting. 2021-04-14T12:59:43.524Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:59:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20ab65-5822-4830-b977-800d4ea5b31e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20ab65-5822-4830-b977-800d4ea5b31e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58c2e547 2021-04-14T12:59:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20ab65-5822-4830-b977-800d4ea5b31e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5e20ab65-5822-4830-b977-800d4ea5b31e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T12:59:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T12:59:48.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1956599-9fc2-4d01-aa4d-2ef9900e2d30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:48.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1956599-9fc2-4d01-aa4d-2ef9900e2d30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@654bfdec 2021-04-14T12:59:48.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1956599-9fc2-4d01-aa4d-2ef9900e2d30 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:48.196Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1956599-9fc2-4d01-aa4d-2ef9900e2d30 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:48.225Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ba4432ec-35c0-49ba-8f35-eb9b593ea52e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:48.225009Z InvocationID=ff2cf1a9-7429-48b8-bd25-427a0d7f1968 LogTimestamp=2021-04-14T12:59:48.225043Z Entering 2021-04-14T12:59:48.225Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ba4432ec-35c0-49ba-8f35-eb9b593ea52e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T12:59:48.225009Z InvocationID=ff2cf1a9-7429-48b8-bd25-427a0d7f1968 LogTimestamp=2021-04-14T12:59:48.225043Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T12:59:48.226Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T12:59:48.225Z InvocationID=1af0339a-1052-4715-ac45-fab9ca14135a LogTimestamp=2021-04-14T12:59:48.226166Z ResponseDesc=OK Exiting. 2021-04-14T12:59:48.226Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T12:59:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f22f41-bc81-414d-bead-827e701f233a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f22f41-bc81-414d-bead-827e701f233a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47ea6266 2021-04-14T12:59:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f22f41-bc81-414d-bead-827e701f233a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44f22f41-bc81-414d-bead-827e701f233a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:53.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088756e8-2fee-439b-90c1-139ffd21f00d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:53.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088756e8-2fee-439b-90c1-139ffd21f00d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46436405 2021-04-14T12:59:53.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088756e8-2fee-439b-90c1-139ffd21f00d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=088756e8-2fee-439b-90c1-139ffd21f00d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee13a5c6-d7a1-4601-b4c5-45261efb4543 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee13a5c6-d7a1-4601-b4c5-45261efb4543 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9645957 2021-04-14T12:59:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee13a5c6-d7a1-4601-b4c5-45261efb4543 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee13a5c6-d7a1-4601-b4c5-45261efb4543 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T12:59:59.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1cd907-2cd6-45dd-a54c-fb97de8686a6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T12:59:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1cd907-2cd6-45dd-a54c-fb97de8686a6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@337a710a 2021-04-14T12:59:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1cd907-2cd6-45dd-a54c-fb97de8686a6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T12:59:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1cd907-2cd6-45dd-a54c-fb97de8686a6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bdd0cf-ff3a-41ec-86ce-e0d2b870db44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bdd0cf-ff3a-41ec-86ce-e0d2b870db44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2797dc51 2021-04-14T13:00:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bdd0cf-ff3a-41ec-86ce-e0d2b870db44 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:02.823Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bdd0cf-ff3a-41ec-86ce-e0d2b870db44 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:00:04.352Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:00:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:00:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:00:04.357Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:00:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:00:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b431d1b4-30b1-48ef-aaa1-40225fc35cd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b431d1b4-30b1-48ef-aaa1-40225fc35cd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aa9f7ea 2021-04-14T13:00:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b431d1b4-30b1-48ef-aaa1-40225fc35cd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b431d1b4-30b1-48ef-aaa1-40225fc35cd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:06.235Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=885b28b7-cb4e-403e-8200-18d4a29d6627 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:00:06.235124Z InvocationID=7c2734be-5f93-4aaa-867f-e96d05b7edf7 LogTimestamp=2021-04-14T13:00:06.235155Z Entering 2021-04-14T13:00:06.235Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=885b28b7-cb4e-403e-8200-18d4a29d6627 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:00:06.235124Z InvocationID=7c2734be-5f93-4aaa-867f-e96d05b7edf7 LogTimestamp=2021-04-14T13:00:06.235155Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:00:06.236Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:00:06.235Z InvocationID=e80a39cd-d8dc-4ba3-8b0d-e33295c5895f LogTimestamp=2021-04-14T13:00:06.236171Z ResponseDesc=OK Exiting. 2021-04-14T13:00:06.236Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:00:08.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f61872-5538-4c5a-977c-c1d789ce618f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:08.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f61872-5538-4c5a-977c-c1d789ce618f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51acb709 2021-04-14T13:00:08.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f61872-5538-4c5a-977c-c1d789ce618f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:08.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7f61872-5538-4c5a-977c-c1d789ce618f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:11.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=534c319b-c19c-47bd-80da-6b7160dfa07c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:11.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=534c319b-c19c-47bd-80da-6b7160dfa07c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31be7e17 2021-04-14T13:00:11.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=534c319b-c19c-47bd-80da-6b7160dfa07c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:11.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=534c319b-c19c-47bd-80da-6b7160dfa07c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fdec60-1698-47a7-9dd7-ce5b61cc6b1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fdec60-1698-47a7-9dd7-ce5b61cc6b1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28525925 2021-04-14T13:00:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fdec60-1698-47a7-9dd7-ce5b61cc6b1a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:14.698Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08fdec60-1698-47a7-9dd7-ce5b61cc6b1a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a1ebe81-77db-4f31-84cb-a0861677f8bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a1ebe81-77db-4f31-84cb-a0861677f8bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d71fd62 2021-04-14T13:00:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a1ebe81-77db-4f31-84cb-a0861677f8bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a1ebe81-77db-4f31-84cb-a0861677f8bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0150d82c-9238-434c-9c2f-82c233dcdb92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0150d82c-9238-434c-9c2f-82c233dcdb92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29d1053a 2021-04-14T13:00:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0150d82c-9238-434c-9c2f-82c233dcdb92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0150d82c-9238-434c-9c2f-82c233dcdb92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:23.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8958efcd-ae00-4260-86d9-4c7b1c62af57 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:23.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8958efcd-ae00-4260-86d9-4c7b1c62af57 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b5d88d1 2021-04-14T13:00:23.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8958efcd-ae00-4260-86d9-4c7b1c62af57 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:23.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8958efcd-ae00-4260-86d9-4c7b1c62af57 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:27.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ada11f3-9c60-4d59-abd0-9cbf7a39bbed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:27.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ada11f3-9c60-4d59-abd0-9cbf7a39bbed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51fc7fee 2021-04-14T13:00:27.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ada11f3-9c60-4d59-abd0-9cbf7a39bbed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:27.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ada11f3-9c60-4d59-abd0-9cbf7a39bbed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f68e8a-b917-4e4c-a413-f1e49ecfbe3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f68e8a-b917-4e4c-a413-f1e49ecfbe3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4374125e 2021-04-14T13:00:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f68e8a-b917-4e4c-a413-f1e49ecfbe3b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=58f68e8a-b917-4e4c-a413-f1e49ecfbe3b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:31.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:33.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a01395-4ee3-463a-ab74-538dbd4617e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:33.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a01395-4ee3-463a-ab74-538dbd4617e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@622d27df 2021-04-14T13:00:33.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a01395-4ee3-463a-ab74-538dbd4617e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:33.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12a01395-4ee3-463a-ab74-538dbd4617e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:34.629Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015o2uwcpdmypr11prfakbi1p3g354 2021-04-14T13:00:34.629Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0fqhwzgu9c3hk1g4aof7psvweg376 2021-04-14T13:00:34.629Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hmzsobjnbxum1nre5y5nw0ut0353 2021-04-14T13:00:34.629Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node065afmbv250sz163jskbcd6fbm392 2021-04-14T13:00:34.629Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hzbnjpxasbcmctyoogy10w3l382 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01pnfjb3m2d84dshkvf17giqzd374 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015bqfewl8hxqjxmpfpyzrp95366 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0widdm9y02lkz1j3dgyh5r0sd1391 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0zwft7b8ehij16zq1yngntki389 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cihmdp5irn921wbjhi0fj0hxc375 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016ygg894ouptdek2ebeux90o1362 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0f752yllfiaaz1qqf8vip3dyxd395 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01uydaxiop4v44xd00g5x6afj7386 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node014nftkvz3fbuy1gkvvb4p1ge6v373 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016uebrzyiw9sw3wulqi1jh8rx397 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019w96m0nyt0aycoydqkt26dyp388 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01l9nei2mgl3x811ejqlvnm8m8v384 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0efshqbb5t13a1hgnfvzv0tcdk399 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01l7duk0r18zkn1bzhs2p3bv2cs394 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cpckubil29xfdwxlrxr5hdi8367 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01c5yqi863pebfonccmnkwcgjf364 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lxy0m46qg32v1g4n3f9u9q8wo368 2021-04-14T13:00:34.630Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bppuctuhn82iexwd5izohudt358 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ttd4x7hrx5big1s0qyu4rnqb355 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01r25z3n6qwt4zly3lm6zlrg8z363 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node04i5kdhuho7b93vku7212g8c1378 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0e6cak8t959im1i8au9osr5wfz387 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018k2hcd48lz3v15s3qvrxavroo385 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09jcc6evkinmc1u7vz22rw1p6g356 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0gn9bri801w2ip99wx0k77pyv377 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019c6ad95h9qabfuddz6i276fg396 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06bxwtlze7a1e17irzagvjqc8y369 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0cl7sr7sdebo1qrzvdqtpuuoz380 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08wbqymukhjfxf1qmcotmmmkn379 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mgtuj0bkkj53zwxnq4zwa48z383 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01mavdbsw88la2fszcazhtgvtj371 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0d7huavbb8xejsk7axi89qcoo360 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05me0tbm8t1hd1muaimhbfgu4r361 2021-04-14T13:00:34.631Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01se49qlm60i22uzabcz7dglt0357 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0v1xwucspg5bkc9akai4qo8pe359 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01glgyy7r8n4csclknwwoak8s9370 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0soidkamfn3jdpuyoz50v8r8u372 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06iqlhqxbdt251ou1373tm8z94390 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0667pw1l9qndjih1vi8wsgwpy393 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01c90p9ifa8ji6zvu1vwpy8v6t365 2021-04-14T13:00:34.632Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0b96bi50f9kgyvvna8ioga69q398 2021-04-14T13:00:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1526f2e7-1015-4043-b57b-743c796a1cb0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1526f2e7-1015-4043-b57b-743c796a1cb0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6531304b 2021-04-14T13:00:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1526f2e7-1015-4043-b57b-743c796a1cb0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:36.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1526f2e7-1015-4043-b57b-743c796a1cb0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:36.226Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4c09e0bb-365c-400f-af30-07b6b92afb38 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:00:36.225582Z InvocationID=5c576870-1f82-49e8-95e5-abcfbfd9468b LogTimestamp=2021-04-14T13:00:36.225656Z Entering 2021-04-14T13:00:36.226Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4c09e0bb-365c-400f-af30-07b6b92afb38 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:00:36.225582Z InvocationID=5c576870-1f82-49e8-95e5-abcfbfd9468b LogTimestamp=2021-04-14T13:00:36.225656Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:00:36.228Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:00:36.226Z InvocationID=b27ce531-e67f-444c-becd-936b88cd0e49 LogTimestamp=2021-04-14T13:00:36.228540Z ResponseDesc=OK Exiting. 2021-04-14T13:00:36.228Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:00:38.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70eb15aa-44a1-492e-ba8e-cb0ff95bb670 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:38.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70eb15aa-44a1-492e-ba8e-cb0ff95bb670 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5700300c 2021-04-14T13:00:38.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70eb15aa-44a1-492e-ba8e-cb0ff95bb670 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:38.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70eb15aa-44a1-492e-ba8e-cb0ff95bb670 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:41.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f4c42b-6a4a-43d4-be1f-857917650e42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:41.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f4c42b-6a4a-43d4-be1f-857917650e42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34853e50 2021-04-14T13:00:41.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f4c42b-6a4a-43d4-be1f-857917650e42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:41.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3f4c42b-6a4a-43d4-be1f-857917650e42 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d74aa20e-80f7-4444-bfaa-f3f746148e91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d74aa20e-80f7-4444-bfaa-f3f746148e91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f9df4c0 2021-04-14T13:00:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d74aa20e-80f7-4444-bfaa-f3f746148e91 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d74aa20e-80f7-4444-bfaa-f3f746148e91 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:00:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:00:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9feafa00-3780-4b75-abdf-2b07cbd072aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9feafa00-3780-4b75-abdf-2b07cbd072aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53c22810 2021-04-14T13:00:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9feafa00-3780-4b75-abdf-2b07cbd072aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:47.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9feafa00-3780-4b75-abdf-2b07cbd072aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55642206-cd83-426b-ad3d-a830f292ee43 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55642206-cd83-426b-ad3d-a830f292ee43 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@514e234 2021-04-14T13:00:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55642206-cd83-426b-ad3d-a830f292ee43 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55642206-cd83-426b-ad3d-a830f292ee43 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:53.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2c8dd7-9e44-4802-9af2-3c42338e8a27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:53.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2c8dd7-9e44-4802-9af2-3c42338e8a27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@187e3b78 2021-04-14T13:00:53.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2c8dd7-9e44-4802-9af2-3c42338e8a27 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:53.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e2c8dd7-9e44-4802-9af2-3c42338e8a27 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:56.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15fc1fb5-2553-491c-8f5c-6dd1f9c3ebc6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:56.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15fc1fb5-2553-491c-8f5c-6dd1f9c3ebc6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4895e743 2021-04-14T13:00:56.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15fc1fb5-2553-491c-8f5c-6dd1f9c3ebc6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:56.943Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15fc1fb5-2553-491c-8f5c-6dd1f9c3ebc6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:00:59.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b48105-88b5-4819-a8d8-2c7928325c82 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:00:59.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b48105-88b5-4819-a8d8-2c7928325c82 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ad5c4e9 2021-04-14T13:00:59.584Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b48105-88b5-4819-a8d8-2c7928325c82 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:00:59.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=13b48105-88b5-4819-a8d8-2c7928325c82 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f796719-a58f-4497-8566-ce47fe98bf1c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f796719-a58f-4497-8566-ce47fe98bf1c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28f292c5 2021-04-14T13:01:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f796719-a58f-4497-8566-ce47fe98bf1c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f796719-a58f-4497-8566-ce47fe98bf1c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:01:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:01:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:01:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:01:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:01:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:01:06.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d55b1d1-00ed-42c2-8020-20869c86d7df PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:06.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d55b1d1-00ed-42c2-8020-20869c86d7df PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a0eb68 2021-04-14T13:01:06.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d55b1d1-00ed-42c2-8020-20869c86d7df PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:06.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d55b1d1-00ed-42c2-8020-20869c86d7df PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:06.238Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=81a424c5-ca41-458d-a494-ae53c309e3fd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:01:06.237913Z InvocationID=35949d47-2980-4bd8-b47f-909e41cb5d89 LogTimestamp=2021-04-14T13:01:06.237956Z Entering 2021-04-14T13:01:06.238Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=81a424c5-ca41-458d-a494-ae53c309e3fd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:01:06.237913Z InvocationID=35949d47-2980-4bd8-b47f-909e41cb5d89 LogTimestamp=2021-04-14T13:01:06.237956Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:01:06.239Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:01:06.238Z InvocationID=6dc233ff-e0b4-44d8-ad4e-458271af5dd2 LogTimestamp=2021-04-14T13:01:06.239430Z ResponseDesc=OK Exiting. 2021-04-14T13:01:06.239Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:01:08.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f107d03b-ed28-46cf-bc28-31b3ad214dbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:08.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f107d03b-ed28-46cf-bc28-31b3ad214dbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ef83543 2021-04-14T13:01:08.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f107d03b-ed28-46cf-bc28-31b3ad214dbb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:08.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f107d03b-ed28-46cf-bc28-31b3ad214dbb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:12.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75893211-82b1-4bee-9a33-c2733cfa7dd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:12.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75893211-82b1-4bee-9a33-c2733cfa7dd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@93bdfdd 2021-04-14T13:01:12.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75893211-82b1-4bee-9a33-c2733cfa7dd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:12.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75893211-82b1-4bee-9a33-c2733cfa7dd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4c1b7d3-c323-41dd-ae8e-1eb6f620543c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4c1b7d3-c323-41dd-ae8e-1eb6f620543c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b51afb0 2021-04-14T13:01:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4c1b7d3-c323-41dd-ae8e-1eb6f620543c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4c1b7d3-c323-41dd-ae8e-1eb6f620543c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d77a99-dc88-4e22-9193-7928843281e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d77a99-dc88-4e22-9193-7928843281e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1eafec19 2021-04-14T13:01:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d77a99-dc88-4e22-9193-7928843281e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:17.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=70d77a99-dc88-4e22-9193-7928843281e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:20.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363f7103-1adc-400b-adc5-4810feea4c7c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:20.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363f7103-1adc-400b-adc5-4810feea4c7c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@610280a2 2021-04-14T13:01:20.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363f7103-1adc-400b-adc5-4810feea4c7c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:20.520Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=363f7103-1adc-400b-adc5-4810feea4c7c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:24.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c87ec0-edaf-4c5f-bd21-a65620ef9020 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:24.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c87ec0-edaf-4c5f-bd21-a65620ef9020 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36107e68 2021-04-14T13:01:24.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c87ec0-edaf-4c5f-bd21-a65620ef9020 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:24.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b3c87ec0-edaf-4c5f-bd21-a65620ef9020 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:27.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=385dfb9c-2b30-475f-8f34-6c31b917faae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:27.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=385dfb9c-2b30-475f-8f34-6c31b917faae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@202a6b35 2021-04-14T13:01:27.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=385dfb9c-2b30-475f-8f34-6c31b917faae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:27.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=385dfb9c-2b30-475f-8f34-6c31b917faae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91046dd1-beab-46e3-b109-362eb04bbbc0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91046dd1-beab-46e3-b109-362eb04bbbc0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4104940d 2021-04-14T13:01:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91046dd1-beab-46e3-b109-362eb04bbbc0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:29.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91046dd1-beab-46e3-b109-362eb04bbbc0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:33.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1524a3ba-6a77-4fce-9d0d-b004a45f3fee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1524a3ba-6a77-4fce-9d0d-b004a45f3fee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34760b1f 2021-04-14T13:01:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1524a3ba-6a77-4fce-9d0d-b004a45f3fee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1524a3ba-6a77-4fce-9d0d-b004a45f3fee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cb8822-da6b-44f8-84e4-4f3b7ad76ad0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cb8822-da6b-44f8-84e4-4f3b7ad76ad0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a0d0c7 2021-04-14T13:01:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cb8822-da6b-44f8-84e4-4f3b7ad76ad0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76cb8822-da6b-44f8-84e4-4f3b7ad76ad0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:36.223Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f0002f4d-db95-4059-8dfc-ec6ff15ef3de InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:01:36.223690Z InvocationID=895ea697-05e2-49e4-87f9-9a500487e104 LogTimestamp=2021-04-14T13:01:36.223724Z Entering 2021-04-14T13:01:36.224Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f0002f4d-db95-4059-8dfc-ec6ff15ef3de InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:01:36.223690Z InvocationID=895ea697-05e2-49e4-87f9-9a500487e104 LogTimestamp=2021-04-14T13:01:36.223724Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:01:36.225Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:01:36.224Z InvocationID=fac4d812-396d-456a-90be-bd480d34bc35 LogTimestamp=2021-04-14T13:01:36.225185Z ResponseDesc=OK Exiting. 2021-04-14T13:01:36.225Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:01:38.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b31f92-3218-45c1-ac58-31d4fbaa96ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:38.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b31f92-3218-45c1-ac58-31d4fbaa96ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72206005 2021-04-14T13:01:38.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b31f92-3218-45c1-ac58-31d4fbaa96ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:38.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b31f92-3218-45c1-ac58-31d4fbaa96ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1276128e-7190-4fe8-8210-e60b4cde7f96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1276128e-7190-4fe8-8210-e60b4cde7f96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17e126b0 2021-04-14T13:01:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1276128e-7190-4fe8-8210-e60b4cde7f96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:41.539Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1276128e-7190-4fe8-8210-e60b4cde7f96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:44.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05a0cdbb-260f-4ed7-9ac2-83ee88b01469 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:44.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05a0cdbb-260f-4ed7-9ac2-83ee88b01469 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@134be9a0 2021-04-14T13:01:44.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05a0cdbb-260f-4ed7-9ac2-83ee88b01469 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:44.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05a0cdbb-260f-4ed7-9ac2-83ee88b01469 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:01:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:01:47.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bc612f-c665-445c-bf2b-369ecca0b014 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:47.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bc612f-c665-445c-bf2b-369ecca0b014 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@146a25e6 2021-04-14T13:01:47.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bc612f-c665-445c-bf2b-369ecca0b014 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:47.701Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bc612f-c665-445c-bf2b-369ecca0b014 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:48.243Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c5065fd3-8002-406f-a5a3-1a8ffa8f20ef InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:01:48.242728Z InvocationID=ec154c3e-709c-4c59-a06d-35c344111f96 LogTimestamp=2021-04-14T13:01:48.242844Z Entering 2021-04-14T13:01:48.243Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c5065fd3-8002-406f-a5a3-1a8ffa8f20ef InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:01:48.242728Z InvocationID=ec154c3e-709c-4c59-a06d-35c344111f96 LogTimestamp=2021-04-14T13:01:48.242844Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:01:48.245Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:01:48.243Z InvocationID=0298095f-83f2-4114-8a46-9a6261eaf85a LogTimestamp=2021-04-14T13:01:48.245250Z ResponseDesc=OK Exiting. 2021-04-14T13:01:48.245Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12180d13-5153-40da-847d-702518da2699 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12180d13-5153-40da-847d-702518da2699 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65bb4f26 2021-04-14T13:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12180d13-5153-40da-847d-702518da2699 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12180d13-5153-40da-847d-702518da2699 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e904c3-5898-4097-8e75-edec3bfe9a60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e904c3-5898-4097-8e75-edec3bfe9a60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bf12187 2021-04-14T13:01:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e904c3-5898-4097-8e75-edec3bfe9a60 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:53.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e904c3-5898-4097-8e75-edec3bfe9a60 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:56.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2edfe65c-48d3-405e-ad79-31e9ad492b26 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:56.903Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2edfe65c-48d3-405e-ad79-31e9ad492b26 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37bbc1b0 2021-04-14T13:01:56.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2edfe65c-48d3-405e-ad79-31e9ad492b26 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:56.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2edfe65c-48d3-405e-ad79-31e9ad492b26 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:01:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395935f4-40a6-478e-be7f-d3cc966b5028 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:01:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395935f4-40a6-478e-be7f-d3cc966b5028 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72bb97b4 2021-04-14T13:01:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395935f4-40a6-478e-be7f-d3cc966b5028 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:01:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=395935f4-40a6-478e-be7f-d3cc966b5028 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:01.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:03.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add621aa-9cf2-4b6b-b682-0937671457d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:03.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add621aa-9cf2-4b6b-b682-0937671457d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d4624ba 2021-04-14T13:02:03.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add621aa-9cf2-4b6b-b682-0937671457d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:03.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add621aa-9cf2-4b6b-b682-0937671457d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:02:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:02:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:02:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:02:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:02:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:02:06.228Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9acbba70-e9d3-4295-8656-f1a7517cb799 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:02:06.227822Z InvocationID=a66b25c7-fc0f-4414-b7bc-8c704fa2de71 LogTimestamp=2021-04-14T13:02:06.227888Z Entering 2021-04-14T13:02:06.228Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9acbba70-e9d3-4295-8656-f1a7517cb799 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:02:06.227822Z InvocationID=a66b25c7-fc0f-4414-b7bc-8c704fa2de71 LogTimestamp=2021-04-14T13:02:06.227888Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:02:06.231Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:02:06.228Z InvocationID=f06c68db-2c99-4949-83ae-5463109f88b2 LogTimestamp=2021-04-14T13:02:06.231517Z ResponseDesc=OK Exiting. 2021-04-14T13:02:06.231Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:02:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2ce393-5ed7-4b6a-92d0-ac47d5b38009 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:06.284Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2ce393-5ed7-4b6a-92d0-ac47d5b38009 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f49c98c 2021-04-14T13:02:06.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2ce393-5ed7-4b6a-92d0-ac47d5b38009 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:06.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2ce393-5ed7-4b6a-92d0-ac47d5b38009 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:08.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964ca49a-78df-4558-b913-ae96262f8cd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:08.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964ca49a-78df-4558-b913-ae96262f8cd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@56162994 2021-04-14T13:02:08.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964ca49a-78df-4558-b913-ae96262f8cd9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:08.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964ca49a-78df-4558-b913-ae96262f8cd9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62bb9029-9c98-46a0-9c43-4bbc076b653c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62bb9029-9c98-46a0-9c43-4bbc076b653c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78be12d5 2021-04-14T13:02:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62bb9029-9c98-46a0-9c43-4bbc076b653c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=62bb9029-9c98-46a0-9c43-4bbc076b653c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:14.808Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16df36de-ee97-425a-9a43-f324b19614a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16df36de-ee97-425a-9a43-f324b19614a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a19a8c 2021-04-14T13:02:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16df36de-ee97-425a-9a43-f324b19614a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16df36de-ee97-425a-9a43-f324b19614a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:18.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc6fd344-ea5a-409c-98c0-736d228fd9b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:18.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc6fd344-ea5a-409c-98c0-736d228fd9b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7555263d 2021-04-14T13:02:18.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc6fd344-ea5a-409c-98c0-736d228fd9b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:18.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc6fd344-ea5a-409c-98c0-736d228fd9b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1b8924c-6961-460d-b367-f43f0f49e719 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1b8924c-6961-460d-b367-f43f0f49e719 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12e8fb8a 2021-04-14T13:02:20.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1b8924c-6961-460d-b367-f43f0f49e719 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:20.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1b8924c-6961-460d-b367-f43f0f49e719 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:23.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf5b5151-be63-4fee-949d-91763ab656b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:23.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf5b5151-be63-4fee-949d-91763ab656b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ac87bb8 2021-04-14T13:02:23.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf5b5151-be63-4fee-949d-91763ab656b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:23.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf5b5151-be63-4fee-949d-91763ab656b1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db8c2ea0-5869-49b9-b36c-0cc03f69eda8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db8c2ea0-5869-49b9-b36c-0cc03f69eda8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1235e797 2021-04-14T13:02:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db8c2ea0-5869-49b9-b36c-0cc03f69eda8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db8c2ea0-5869-49b9-b36c-0cc03f69eda8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:30.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99793056-7138-4723-a1a6-29205fba583a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:30.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99793056-7138-4723-a1a6-29205fba583a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e8d4f22 2021-04-14T13:02:30.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99793056-7138-4723-a1a6-29205fba583a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:30.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99793056-7138-4723-a1a6-29205fba583a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:33.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=620a74b2-882b-4acf-ad7d-99e431d708de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:33.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=620a74b2-882b-4acf-ad7d-99e431d708de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b6cc9d2 2021-04-14T13:02:33.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=620a74b2-882b-4acf-ad7d-99e431d708de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:33.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=620a74b2-882b-4acf-ad7d-99e431d708de PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:35.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04ec523-6fce-4998-a6b0-9c160cb86a09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:35.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04ec523-6fce-4998-a6b0-9c160cb86a09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42a064bc 2021-04-14T13:02:35.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04ec523-6fce-4998-a6b0-9c160cb86a09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:35.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c04ec523-6fce-4998-a6b0-9c160cb86a09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:36.229Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7f9142de-02f9-4071-84ef-a15dade4a36a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:02:36.229471Z InvocationID=c7dc105b-26ee-495f-8a06-028d1d13ad66 LogTimestamp=2021-04-14T13:02:36.229515Z Entering 2021-04-14T13:02:36.229Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7f9142de-02f9-4071-84ef-a15dade4a36a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:02:36.229471Z InvocationID=c7dc105b-26ee-495f-8a06-028d1d13ad66 LogTimestamp=2021-04-14T13:02:36.229515Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:02:36.230Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:02:36.229Z InvocationID=e2171f27-ac2f-478d-b966-ad3011a419d2 LogTimestamp=2021-04-14T13:02:36.230878Z ResponseDesc=OK Exiting. 2021-04-14T13:02:36.231Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:02:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d9c0e64-6e74-4a1f-ad35-92c468f5399e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d9c0e64-6e74-4a1f-ad35-92c468f5399e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f142a20 2021-04-14T13:02:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d9c0e64-6e74-4a1f-ad35-92c468f5399e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d9c0e64-6e74-4a1f-ad35-92c468f5399e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9756e3-8f37-4022-99fd-a164c862a9b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9756e3-8f37-4022-99fd-a164c862a9b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b448ebf 2021-04-14T13:02:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9756e3-8f37-4022-99fd-a164c862a9b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c9756e3-8f37-4022-99fd-a164c862a9b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f96fe0-d497-4a06-8b5a-c2e06adf266a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f96fe0-d497-4a06-8b5a-c2e06adf266a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@261bee5c 2021-04-14T13:02:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f96fe0-d497-4a06-8b5a-c2e06adf266a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39f96fe0-d497-4a06-8b5a-c2e06adf266a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:02:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:02:47.888Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63429707-8f0e-4192-aa1a-842b964e73a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63429707-8f0e-4192-aa1a-842b964e73a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@675ffba7 2021-04-14T13:02:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63429707-8f0e-4192-aa1a-842b964e73a2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=63429707-8f0e-4192-aa1a-842b964e73a2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:51.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d125713c-c16a-42c8-ae35-e2cab234877a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:51.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d125713c-c16a-42c8-ae35-e2cab234877a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39c49846 2021-04-14T13:02:51.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d125713c-c16a-42c8-ae35-e2cab234877a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:51.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d125713c-c16a-42c8-ae35-e2cab234877a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48eedcb4-c132-4ac0-8198-bbb4176b13e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:53.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48eedcb4-c132-4ac0-8198-bbb4176b13e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@460ac8b7 2021-04-14T13:02:53.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48eedcb4-c132-4ac0-8198-bbb4176b13e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:53.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48eedcb4-c132-4ac0-8198-bbb4176b13e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:57.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7754555d-21d5-41fa-8c42-09b75f9e01b4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7754555d-21d5-41fa-8c42-09b75f9e01b4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f1aa724 2021-04-14T13:02:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7754555d-21d5-41fa-8c42-09b75f9e01b4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:57.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7754555d-21d5-41fa-8c42-09b75f9e01b4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:02:59.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a8fc4c9-e372-4687-af54-843e750c33ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:02:59.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a8fc4c9-e372-4687-af54-843e750c33ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2700e1a3 2021-04-14T13:02:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a8fc4c9-e372-4687-af54-843e750c33ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:02:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a8fc4c9-e372-4687-af54-843e750c33ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ec14dc-61eb-45d3-9bc5-d61c83c503ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ec14dc-61eb-45d3-9bc5-d61c83c503ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a9b5bad 2021-04-14T13:03:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ec14dc-61eb-45d3-9bc5-d61c83c503ff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3ec14dc-61eb-45d3-9bc5-d61c83c503ff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:03:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:03:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:03:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:03:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:03:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:03:06.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1956077-50e8-4767-b88b-71a1ad2b1360 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:06.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1956077-50e8-4767-b88b-71a1ad2b1360 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ac46339 2021-04-14T13:03:06.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1956077-50e8-4767-b88b-71a1ad2b1360 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:06.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1956077-50e8-4767-b88b-71a1ad2b1360 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:06.238Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ccd13a23-693c-4e7c-8ab1-be7d0e92d582 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:03:06.238337Z InvocationID=91972aae-e64d-402d-8a6a-b38bc6cb9fac LogTimestamp=2021-04-14T13:03:06.238394Z Entering 2021-04-14T13:03:06.238Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ccd13a23-693c-4e7c-8ab1-be7d0e92d582 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:03:06.238337Z InvocationID=91972aae-e64d-402d-8a6a-b38bc6cb9fac LogTimestamp=2021-04-14T13:03:06.238394Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:03:06.240Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:03:06.239Z InvocationID=3854785c-79d7-4bdc-9045-379fce432ad7 LogTimestamp=2021-04-14T13:03:06.240480Z ResponseDesc=OK Exiting. 2021-04-14T13:03:06.240Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:03:09.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=217db958-df78-4711-aefc-44e9a2091b86 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:09.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=217db958-df78-4711-aefc-44e9a2091b86 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@400dc2c2 2021-04-14T13:03:09.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=217db958-df78-4711-aefc-44e9a2091b86 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:09.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=217db958-df78-4711-aefc-44e9a2091b86 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=927f72df-499d-4ef5-908d-cf9ef31e3ad8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=927f72df-499d-4ef5-908d-cf9ef31e3ad8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60a02e99 2021-04-14T13:03:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=927f72df-499d-4ef5-908d-cf9ef31e3ad8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=927f72df-499d-4ef5-908d-cf9ef31e3ad8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:14.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4df96364-913e-4604-86ce-d1539ff6019c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:14.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4df96364-913e-4604-86ce-d1539ff6019c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65713 2021-04-14T13:03:14.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4df96364-913e-4604-86ce-d1539ff6019c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:14.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4df96364-913e-4604-86ce-d1539ff6019c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:16.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:16.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:18.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccdbaa03-3410-419a-8295-d622377205ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:18.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccdbaa03-3410-419a-8295-d622377205ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9d23181 2021-04-14T13:03:18.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccdbaa03-3410-419a-8295-d622377205ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:18.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccdbaa03-3410-419a-8295-d622377205ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:20.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1de2e32-b136-4f01-949a-addba55e786f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:20.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1de2e32-b136-4f01-949a-addba55e786f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2767e9ab 2021-04-14T13:03:20.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1de2e32-b136-4f01-949a-addba55e786f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:20.593Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1de2e32-b136-4f01-949a-addba55e786f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cd691b1-1248-4248-be35-0dc05d3f639f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cd691b1-1248-4248-be35-0dc05d3f639f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46d2df38 2021-04-14T13:03:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cd691b1-1248-4248-be35-0dc05d3f639f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4cd691b1-1248-4248-be35-0dc05d3f639f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:26.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c01c03b-d6ed-46a7-a52c-f919668865d2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c01c03b-d6ed-46a7-a52c-f919668865d2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74dea63e 2021-04-14T13:03:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c01c03b-d6ed-46a7-a52c-f919668865d2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:26.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c01c03b-d6ed-46a7-a52c-f919668865d2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:29.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=029713cb-1c0e-43b9-afeb-c68e349de371 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:29.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=029713cb-1c0e-43b9-afeb-c68e349de371 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c98df1d 2021-04-14T13:03:29.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=029713cb-1c0e-43b9-afeb-c68e349de371 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:29.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=029713cb-1c0e-43b9-afeb-c68e349de371 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd9657b-1881-46cb-b804-bf6985cf09a7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd9657b-1881-46cb-b804-bf6985cf09a7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74aa5994 2021-04-14T13:03:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd9657b-1881-46cb-b804-bf6985cf09a7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:33.016Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4bd9657b-1881-46cb-b804-bf6985cf09a7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b107a367-4428-4f13-a47b-00ca6077fb96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b107a367-4428-4f13-a47b-00ca6077fb96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24517326 2021-04-14T13:03:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b107a367-4428-4f13-a47b-00ca6077fb96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b107a367-4428-4f13-a47b-00ca6077fb96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:36.338Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8eda16d7-3f8c-463b-ba6f-eaac16ec07c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:03:36.338115Z InvocationID=ce0b5059-5c89-4cf8-af5e-ae6433c8c37c LogTimestamp=2021-04-14T13:03:36.338197Z Entering 2021-04-14T13:03:36.338Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8eda16d7-3f8c-463b-ba6f-eaac16ec07c4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:03:36.338115Z InvocationID=ce0b5059-5c89-4cf8-af5e-ae6433c8c37c LogTimestamp=2021-04-14T13:03:36.338197Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:03:36.342Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:03:36.339Z InvocationID=29bb15e0-c067-4316-b470-650d23fe5aab LogTimestamp=2021-04-14T13:03:36.342060Z ResponseDesc=OK Exiting. 2021-04-14T13:03:36.342Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:03:39.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0cfbfed-8e35-44e7-a6eb-bd7c40f153c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:39.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0cfbfed-8e35-44e7-a6eb-bd7c40f153c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25bfcec4 2021-04-14T13:03:39.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0cfbfed-8e35-44e7-a6eb-bd7c40f153c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:39.142Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a0cfbfed-8e35-44e7-a6eb-bd7c40f153c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:41.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159663ec-c3d2-41fe-a1a1-2d9e23c4c95b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:41.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159663ec-c3d2-41fe-a1a1-2d9e23c4c95b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ff59d59 2021-04-14T13:03:41.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159663ec-c3d2-41fe-a1a1-2d9e23c4c95b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:41.529Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=159663ec-c3d2-41fe-a1a1-2d9e23c4c95b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf2b24-2888-486b-9d3c-f7df8eb6088e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf2b24-2888-486b-9d3c-f7df8eb6088e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@293503ca 2021-04-14T13:03:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf2b24-2888-486b-9d3c-f7df8eb6088e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:45.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf2b24-2888-486b-9d3c-f7df8eb6088e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:03:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:03:47.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a008f7a8-01e2-4407-9b4e-27bfe1ebf8dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:47.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a008f7a8-01e2-4407-9b4e-27bfe1ebf8dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6529d89 2021-04-14T13:03:47.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a008f7a8-01e2-4407-9b4e-27bfe1ebf8dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:47.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a008f7a8-01e2-4407-9b4e-27bfe1ebf8dd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:48.235Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=305f115a-026d-496f-8027-e6e081e2a17e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:03:48.235612Z InvocationID=9906025f-929b-4cc6-9bf6-74cc591ef770 LogTimestamp=2021-04-14T13:03:48.235681Z Entering 2021-04-14T13:03:48.236Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=305f115a-026d-496f-8027-e6e081e2a17e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:03:48.235612Z InvocationID=9906025f-929b-4cc6-9bf6-74cc591ef770 LogTimestamp=2021-04-14T13:03:48.235681Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:03:48.237Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:03:48.236Z InvocationID=ffff65b4-17e4-40f3-a0e2-374cc490fce5 LogTimestamp=2021-04-14T13:03:48.237290Z ResponseDesc=OK Exiting. 2021-04-14T13:03:48.237Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:03:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f1c53d-1355-4389-9ab1-42189eca1b5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f1c53d-1355-4389-9ab1-42189eca1b5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d40ba69 2021-04-14T13:03:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f1c53d-1355-4389-9ab1-42189eca1b5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:51.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14f1c53d-1355-4389-9ab1-42189eca1b5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:53.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfd7300-8b2b-4c0f-95c3-fe76c1c42bb6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:53.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfd7300-8b2b-4c0f-95c3-fe76c1c42bb6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7efcebcd 2021-04-14T13:03:53.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfd7300-8b2b-4c0f-95c3-fe76c1c42bb6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:53.853Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9bfd7300-8b2b-4c0f-95c3-fe76c1c42bb6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3bff65-3c90-4766-9284-00a0e265af78 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3bff65-3c90-4766-9284-00a0e265af78 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fd69c8b 2021-04-14T13:03:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3bff65-3c90-4766-9284-00a0e265af78 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=be3bff65-3c90-4766-9284-00a0e265af78 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:03:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acb84d51-b5ae-4c36-8f41-9bdb60f9ad7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:03:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acb84d51-b5ae-4c36-8f41-9bdb60f9ad7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6dfaf82d 2021-04-14T13:03:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acb84d51-b5ae-4c36-8f41-9bdb60f9ad7f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:03:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=acb84d51-b5ae-4c36-8f41-9bdb60f9ad7f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:01.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f15c4f75-4f36-4911-944c-d9841613a2c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f15c4f75-4f36-4911-944c-d9841613a2c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35b18409 2021-04-14T13:04:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f15c4f75-4f36-4911-944c-d9841613a2c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f15c4f75-4f36-4911-944c-d9841613a2c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:04:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:04:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:04:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:04:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:04:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:04:06.243Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cff88004-b76c-43a6-9ee3-6e92771d3551 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:04:06.243364Z InvocationID=271e5afa-67c8-41ff-b146-3b1e5841b0bf LogTimestamp=2021-04-14T13:04:06.243402Z Entering 2021-04-14T13:04:06.243Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cff88004-b76c-43a6-9ee3-6e92771d3551 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:04:06.243364Z InvocationID=271e5afa-67c8-41ff-b146-3b1e5841b0bf LogTimestamp=2021-04-14T13:04:06.243402Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:04:06.245Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:04:06.243Z InvocationID=e61bf57f-8521-4085-b971-616b6b44e955 LogTimestamp=2021-04-14T13:04:06.244973Z ResponseDesc=OK Exiting. 2021-04-14T13:04:06.245Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:04:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bff3391-dfe0-4d64-9a78-b9e8d5601968 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bff3391-dfe0-4d64-9a78-b9e8d5601968 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c8aa3f1 2021-04-14T13:04:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bff3391-dfe0-4d64-9a78-b9e8d5601968 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:06.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bff3391-dfe0-4d64-9a78-b9e8d5601968 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a3bd640-58b8-4337-a100-429ec590970d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a3bd640-58b8-4337-a100-429ec590970d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6773402f 2021-04-14T13:04:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a3bd640-58b8-4337-a100-429ec590970d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a3bd640-58b8-4337-a100-429ec590970d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:12.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6e489e-ee5d-48b2-b23f-d19c77e893c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:12.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6e489e-ee5d-48b2-b23f-d19c77e893c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d72e77c 2021-04-14T13:04:12.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6e489e-ee5d-48b2-b23f-d19c77e893c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:12.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6e489e-ee5d-48b2-b23f-d19c77e893c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f8e977b-59fb-4d48-9a22-aa50107a46db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f8e977b-59fb-4d48-9a22-aa50107a46db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@645ab117 2021-04-14T13:04:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f8e977b-59fb-4d48-9a22-aa50107a46db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f8e977b-59fb-4d48-9a22-aa50107a46db PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a90131-8282-487d-9b14-990325b97118 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:17.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a90131-8282-487d-9b14-990325b97118 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d361346 2021-04-14T13:04:17.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a90131-8282-487d-9b14-990325b97118 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:17.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31a90131-8282-487d-9b14-990325b97118 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f732be9b-7c99-4ca6-8a59-b942bf80467b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:20.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f732be9b-7c99-4ca6-8a59-b942bf80467b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60b95af7 2021-04-14T13:04:20.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f732be9b-7c99-4ca6-8a59-b942bf80467b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:20.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f732be9b-7c99-4ca6-8a59-b942bf80467b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e307dfa-d998-455c-bac9-03b7b931397b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e307dfa-d998-455c-bac9-03b7b931397b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a3a089b 2021-04-14T13:04:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e307dfa-d998-455c-bac9-03b7b931397b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:24.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1e307dfa-d998-455c-bac9-03b7b931397b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c1548-784a-4268-861d-f74b9806b41e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c1548-784a-4268-861d-f74b9806b41e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bd9d6c2 2021-04-14T13:04:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c1548-784a-4268-861d-f74b9806b41e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e56c1548-784a-4268-861d-f74b9806b41e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eceae27e-2cd5-4087-837a-170b583f9162 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eceae27e-2cd5-4087-837a-170b583f9162 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@36d85adc 2021-04-14T13:04:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eceae27e-2cd5-4087-837a-170b583f9162 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:29.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eceae27e-2cd5-4087-837a-170b583f9162 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ad38e9-653a-4afb-9125-d0f9cc00fb84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ad38e9-653a-4afb-9125-d0f9cc00fb84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c9cc012 2021-04-14T13:04:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ad38e9-653a-4afb-9125-d0f9cc00fb84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:33.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9ad38e9-653a-4afb-9125-d0f9cc00fb84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:36.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace5aec0-fca7-4688-a8c4-bce5943d04d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:36.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace5aec0-fca7-4688-a8c4-bce5943d04d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66187dca 2021-04-14T13:04:36.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace5aec0-fca7-4688-a8c4-bce5943d04d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:36.009Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ace5aec0-fca7-4688-a8c4-bce5943d04d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:36.235Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6dd0e3da-b07f-4939-8058-65cefcf80cc1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:04:36.234217Z InvocationID=90b15313-6bf9-4463-95b9-76e0a67b3e18 LogTimestamp=2021-04-14T13:04:36.234335Z Entering 2021-04-14T13:04:36.235Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6dd0e3da-b07f-4939-8058-65cefcf80cc1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:04:36.234217Z InvocationID=90b15313-6bf9-4463-95b9-76e0a67b3e18 LogTimestamp=2021-04-14T13:04:36.234335Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:04:36.238Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:04:36.235Z InvocationID=bc6b9b0b-89c9-46fd-a841-3e219a764b1a LogTimestamp=2021-04-14T13:04:36.238771Z ResponseDesc=OK Exiting. 2021-04-14T13:04:36.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:04:39.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e49cc-e9a2-4abe-ab6d-b3e15bcf5cdf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:39.099Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e49cc-e9a2-4abe-ab6d-b3e15bcf5cdf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33a2d80d 2021-04-14T13:04:39.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e49cc-e9a2-4abe-ab6d-b3e15bcf5cdf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:39.100Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f31e49cc-e9a2-4abe-ab6d-b3e15bcf5cdf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe86fa1-1cb2-4d40-8087-0afda3412b70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe86fa1-1cb2-4d40-8087-0afda3412b70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47d87a1f 2021-04-14T13:04:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe86fa1-1cb2-4d40-8087-0afda3412b70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffe86fa1-1cb2-4d40-8087-0afda3412b70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:45.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96add7a-a9ef-4774-9115-2ac2f28f6117 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:45.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96add7a-a9ef-4774-9115-2ac2f28f6117 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d3eaea6 2021-04-14T13:04:45.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96add7a-a9ef-4774-9115-2ac2f28f6117 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:45.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b96add7a-a9ef-4774-9115-2ac2f28f6117 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:04:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:04:48.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb17751f-3763-49f1-ae22-8fd0705fd60a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:48.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb17751f-3763-49f1-ae22-8fd0705fd60a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@186d62e6 2021-04-14T13:04:48.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb17751f-3763-49f1-ae22-8fd0705fd60a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:48.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb17751f-3763-49f1-ae22-8fd0705fd60a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7580bb7-a89b-48fb-a42e-a0c7d38f0620 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7580bb7-a89b-48fb-a42e-a0c7d38f0620 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3daab356 2021-04-14T13:04:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7580bb7-a89b-48fb-a42e-a0c7d38f0620 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7580bb7-a89b-48fb-a42e-a0c7d38f0620 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:53.927Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27460df7-b8c6-453c-91b2-db6d79bd2da1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:53.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27460df7-b8c6-453c-91b2-db6d79bd2da1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39a62e7e 2021-04-14T13:04:53.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27460df7-b8c6-453c-91b2-db6d79bd2da1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:53.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27460df7-b8c6-453c-91b2-db6d79bd2da1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:56.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8661f184-6bd2-4a0b-9911-bcfdfa926d56 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:56.906Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8661f184-6bd2-4a0b-9911-bcfdfa926d56 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71a5ec72 2021-04-14T13:04:56.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8661f184-6bd2-4a0b-9911-bcfdfa926d56 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:56.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8661f184-6bd2-4a0b-9911-bcfdfa926d56 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:04:59.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50752564-8570-4a6e-b6a4-bf8dd6fcf47e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:04:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50752564-8570-4a6e-b6a4-bf8dd6fcf47e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2acdaf2 2021-04-14T13:04:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50752564-8570-4a6e-b6a4-bf8dd6fcf47e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:04:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50752564-8570-4a6e-b6a4-bf8dd6fcf47e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed242d4-7596-4a48-b5c2-5c284a6d9693 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed242d4-7596-4a48-b5c2-5c284a6d9693 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a74f9f2 2021-04-14T13:05:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed242d4-7596-4a48-b5c2-5c284a6d9693 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ed242d4-7596-4a48-b5c2-5c284a6d9693 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:05:04.352Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:05:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:05:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:05:04.357Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:05:04.358Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:05:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1a9fb5d-521c-4a06-a3df-26ce94d09836 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1a9fb5d-521c-4a06-a3df-26ce94d09836 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6229ff1c 2021-04-14T13:05:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1a9fb5d-521c-4a06-a3df-26ce94d09836 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:06.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1a9fb5d-521c-4a06-a3df-26ce94d09836 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:06.235Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c4bdc19e-528d-4a17-ac56-859fdea31a7f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:05:06.235145Z InvocationID=607af5ba-db07-4d94-bd20-3acad9fec5b4 LogTimestamp=2021-04-14T13:05:06.235199Z Entering 2021-04-14T13:05:06.235Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c4bdc19e-528d-4a17-ac56-859fdea31a7f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:05:06.235145Z InvocationID=607af5ba-db07-4d94-bd20-3acad9fec5b4 LogTimestamp=2021-04-14T13:05:06.235199Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:05:06.237Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:05:06.235Z InvocationID=52de56a5-509b-4e3b-9c2f-6995d9a87de7 LogTimestamp=2021-04-14T13:05:06.237066Z ResponseDesc=OK Exiting. 2021-04-14T13:05:06.237Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:05:09.080Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b33c38-2551-4c46-a29c-334ed6e395a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b33c38-2551-4c46-a29c-334ed6e395a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c315957 2021-04-14T13:05:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b33c38-2551-4c46-a29c-334ed6e395a9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3b33c38-2551-4c46-a29c-334ed6e395a9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2ded1db-3322-4787-a014-f956aab9a1b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2ded1db-3322-4787-a014-f956aab9a1b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58ae6f69 2021-04-14T13:05:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2ded1db-3322-4787-a014-f956aab9a1b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:12.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2ded1db-3322-4787-a014-f956aab9a1b8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173487c-8992-48b5-9598-babbbb1ed97e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173487c-8992-48b5-9598-babbbb1ed97e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15d8a6e7 2021-04-14T13:05:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173487c-8992-48b5-9598-babbbb1ed97e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:14.616Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4173487c-8992-48b5-9598-babbbb1ed97e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:18.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf15ad79-5f47-4f0c-92cf-5c17a42ce29e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:18.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf15ad79-5f47-4f0c-92cf-5c17a42ce29e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38a46a5f 2021-04-14T13:05:18.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf15ad79-5f47-4f0c-92cf-5c17a42ce29e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:18.189Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cf15ad79-5f47-4f0c-92cf-5c17a42ce29e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:20.619Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecde6578-c25b-43bf-8acd-9e5fe7527016 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:20.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecde6578-c25b-43bf-8acd-9e5fe7527016 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ee967fd 2021-04-14T13:05:20.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecde6578-c25b-43bf-8acd-9e5fe7527016 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:20.620Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ecde6578-c25b-43bf-8acd-9e5fe7527016 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:24.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34c48e05-42ea-4dfe-816b-fa59ce1d453d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:24.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34c48e05-42ea-4dfe-816b-fa59ce1d453d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2597946e 2021-04-14T13:05:24.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34c48e05-42ea-4dfe-816b-fa59ce1d453d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:24.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34c48e05-42ea-4dfe-816b-fa59ce1d453d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93a9be0-a1bf-493c-892b-a5d72e96b793 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93a9be0-a1bf-493c-892b-a5d72e96b793 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75a8f1a5 2021-04-14T13:05:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93a9be0-a1bf-493c-892b-a5d72e96b793 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f93a9be0-a1bf-493c-892b-a5d72e96b793 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:30.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd762553-996d-478b-bff6-335a850249c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:30.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd762553-996d-478b-bff6-335a850249c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ec59bdd 2021-04-14T13:05:30.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd762553-996d-478b-bff6-335a850249c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:30.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd762553-996d-478b-bff6-335a850249c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8da7765-311c-4f7d-b9c0-2ed33997a2c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8da7765-311c-4f7d-b9c0-2ed33997a2c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b56df77 2021-04-14T13:05:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8da7765-311c-4f7d-b9c0-2ed33997a2c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8da7765-311c-4f7d-b9c0-2ed33997a2c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7346fc-efa5-40d2-ad85-8050522e78d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7346fc-efa5-40d2-ad85-8050522e78d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@327b1a97 2021-04-14T13:05:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7346fc-efa5-40d2-ad85-8050522e78d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:35.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f7346fc-efa5-40d2-ad85-8050522e78d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:36.246Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=64012f1e-15ff-4ac6-b27c-ab579ab903e1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:05:36.245734Z InvocationID=2944503f-c8f7-4e77-b9ad-772c1496877b LogTimestamp=2021-04-14T13:05:36.245794Z Entering 2021-04-14T13:05:36.246Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=64012f1e-15ff-4ac6-b27c-ab579ab903e1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:05:36.245734Z InvocationID=2944503f-c8f7-4e77-b9ad-772c1496877b LogTimestamp=2021-04-14T13:05:36.245794Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:05:36.247Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:05:36.246Z InvocationID=790549b3-7b25-4e61-93a6-c248c36f5720 LogTimestamp=2021-04-14T13:05:36.247864Z ResponseDesc=OK Exiting. 2021-04-14T13:05:36.248Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:05:39.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52fa3a7b-6775-4bef-a2b4-804bf902b471 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:39.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52fa3a7b-6775-4bef-a2b4-804bf902b471 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cf0a4 2021-04-14T13:05:39.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52fa3a7b-6775-4bef-a2b4-804bf902b471 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:39.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52fa3a7b-6775-4bef-a2b4-804bf902b471 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8e5f9f5-3e49-4d0d-8b21-a8c2544c8aad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8e5f9f5-3e49-4d0d-8b21-a8c2544c8aad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42b58807 2021-04-14T13:05:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8e5f9f5-3e49-4d0d-8b21-a8c2544c8aad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a8e5f9f5-3e49-4d0d-8b21-a8c2544c8aad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:44.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fb974fb-4cb6-4ea0-b028-1371e9eccce1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:44.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fb974fb-4cb6-4ea0-b028-1371e9eccce1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f054a41 2021-04-14T13:05:44.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fb974fb-4cb6-4ea0-b028-1371e9eccce1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:44.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4fb974fb-4cb6-4ea0-b028-1371e9eccce1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:05:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:05:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f843f4bf-7951-476c-afec-90d5afc39f5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f843f4bf-7951-476c-afec-90d5afc39f5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35c04c94 2021-04-14T13:05:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f843f4bf-7951-476c-afec-90d5afc39f5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:47.796Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f843f4bf-7951-476c-afec-90d5afc39f5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:48.243Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ad9e8a7f-8c0a-498e-a3e4-a64392b5e02d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:05:48.243284Z InvocationID=9e0b0660-2673-4c26-b20f-fa5333ced0e4 LogTimestamp=2021-04-14T13:05:48.243342Z Entering 2021-04-14T13:05:48.244Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ad9e8a7f-8c0a-498e-a3e4-a64392b5e02d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:05:48.243284Z InvocationID=9e0b0660-2673-4c26-b20f-fa5333ced0e4 LogTimestamp=2021-04-14T13:05:48.243342Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:05:48.246Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:05:48.244Z InvocationID=a9eacbd2-e23b-43d7-9ef6-932df55af799 LogTimestamp=2021-04-14T13:05:48.246637Z ResponseDesc=OK Exiting. 2021-04-14T13:05:48.247Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:05:51.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4126164-b45b-44f7-b0a9-7bedaa6d1def PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:51.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4126164-b45b-44f7-b0a9-7bedaa6d1def PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52ce7358 2021-04-14T13:05:51.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4126164-b45b-44f7-b0a9-7bedaa6d1def PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:51.612Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4126164-b45b-44f7-b0a9-7bedaa6d1def PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:54.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7787872e-e22c-4cc5-9a61-b31a03962438 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:54.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7787872e-e22c-4cc5-9a61-b31a03962438 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cd52cb6 2021-04-14T13:05:54.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7787872e-e22c-4cc5-9a61-b31a03962438 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:54.211Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7787872e-e22c-4cc5-9a61-b31a03962438 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd56578-e500-40df-9c15-a6b63c52e4fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd56578-e500-40df-9c15-a6b63c52e4fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49f73e2f 2021-04-14T13:05:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd56578-e500-40df-9c15-a6b63c52e4fb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:56.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=abd56578-e500-40df-9c15-a6b63c52e4fb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:05:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b827f040-7c0f-4c0d-862d-1b6258c71bc2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:05:59.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b827f040-7c0f-4c0d-862d-1b6258c71bc2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e647f69 2021-04-14T13:05:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b827f040-7c0f-4c0d-862d-1b6258c71bc2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:05:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b827f040-7c0f-4c0d-862d-1b6258c71bc2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:02.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc9f4d-d870-4af3-81ea-ef96a384d695 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:02.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc9f4d-d870-4af3-81ea-ef96a384d695 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f91974e 2021-04-14T13:06:02.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc9f4d-d870-4af3-81ea-ef96a384d695 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:02.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbbc9f4d-d870-4af3-81ea-ef96a384d695 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:06:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:06:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:06:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:06:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:06:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:06:06.232Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ad9cf6fd-34e0-4117-9a6b-9bf7fbbc144d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:06:06.231663Z InvocationID=4243951a-5c37-4479-984a-a1617a3c012f LogTimestamp=2021-04-14T13:06:06.231724Z Entering 2021-04-14T13:06:06.232Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ad9cf6fd-34e0-4117-9a6b-9bf7fbbc144d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:06:06.231663Z InvocationID=4243951a-5c37-4479-984a-a1617a3c012f LogTimestamp=2021-04-14T13:06:06.231724Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:06:06.233Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:06:06.232Z InvocationID=c791e832-b2fb-48a8-afc5-01a76cb3f920 LogTimestamp=2021-04-14T13:06:06.233751Z ResponseDesc=OK Exiting. 2021-04-14T13:06:06.234Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:06:06.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17ad5dc-fcb8-4aa0-9869-1721b4c87af8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:06.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17ad5dc-fcb8-4aa0-9869-1721b4c87af8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ab4a096 2021-04-14T13:06:06.382Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17ad5dc-fcb8-4aa0-9869-1721b4c87af8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:06.383Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a17ad5dc-fcb8-4aa0-9869-1721b4c87af8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61cfb1b5-e1dd-4c4b-8b33-7eafb3393b7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61cfb1b5-e1dd-4c4b-8b33-7eafb3393b7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a42e9a9 2021-04-14T13:06:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61cfb1b5-e1dd-4c4b-8b33-7eafb3393b7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:09.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61cfb1b5-e1dd-4c4b-8b33-7eafb3393b7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc2e622-73ee-471b-9adf-a04dc06ef21b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc2e622-73ee-471b-9adf-a04dc06ef21b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@678056bf 2021-04-14T13:06:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc2e622-73ee-471b-9adf-a04dc06ef21b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:11.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cc2e622-73ee-471b-9adf-a04dc06ef21b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf87bca-23de-4e36-b9e4-cb80bc6a8f40 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf87bca-23de-4e36-b9e4-cb80bc6a8f40 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34f886e6 2021-04-14T13:06:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf87bca-23de-4e36-b9e4-cb80bc6a8f40 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5bf87bca-23de-4e36-b9e4-cb80bc6a8f40 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:16.201Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:16.205Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:16.206Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:16.207Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:18.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09300856-d3ff-451e-8a36-ca53b10a48e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:18.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09300856-d3ff-451e-8a36-ca53b10a48e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ba730ff 2021-04-14T13:06:18.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09300856-d3ff-451e-8a36-ca53b10a48e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:18.185Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=09300856-d3ff-451e-8a36-ca53b10a48e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1c42244-7f5d-4d1c-9359-ffb686c20a11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1c42244-7f5d-4d1c-9359-ffb686c20a11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76059583 2021-04-14T13:06:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1c42244-7f5d-4d1c-9359-ffb686c20a11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:20.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1c42244-7f5d-4d1c-9359-ffb686c20a11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305e5ae2-d085-4760-9194-c4fa1286b355 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305e5ae2-d085-4760-9194-c4fa1286b355 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13d51052 2021-04-14T13:06:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305e5ae2-d085-4760-9194-c4fa1286b355 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=305e5ae2-d085-4760-9194-c4fa1286b355 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:26.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30685406-dc2a-4df4-a78b-8d0dad629baf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:26.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30685406-dc2a-4df4-a78b-8d0dad629baf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@636a6b78 2021-04-14T13:06:26.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30685406-dc2a-4df4-a78b-8d0dad629baf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:26.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=30685406-dc2a-4df4-a78b-8d0dad629baf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b168878-11a3-462e-a667-3180f8c0705c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b168878-11a3-462e-a667-3180f8c0705c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1288f22 2021-04-14T13:06:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b168878-11a3-462e-a667-3180f8c0705c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b168878-11a3-462e-a667-3180f8c0705c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4545470f-caff-426c-b8e2-df2abd677178 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4545470f-caff-426c-b8e2-df2abd677178 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b5bab09 2021-04-14T13:06:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4545470f-caff-426c-b8e2-df2abd677178 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:33.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4545470f-caff-426c-b8e2-df2abd677178 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e49f97ac-0850-4c75-935e-fecd02a3a0ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e49f97ac-0850-4c75-935e-fecd02a3a0ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60b767b0 2021-04-14T13:06:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e49f97ac-0850-4c75-935e-fecd02a3a0ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e49f97ac-0850-4c75-935e-fecd02a3a0ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:36.233Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1b195310-d527-46b1-b4a2-f1c3d4508bb5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:06:36.233296Z InvocationID=30162e32-696d-4203-8344-56d542b86ca6 LogTimestamp=2021-04-14T13:06:36.233330Z Entering 2021-04-14T13:06:36.233Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1b195310-d527-46b1-b4a2-f1c3d4508bb5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:06:36.233296Z InvocationID=30162e32-696d-4203-8344-56d542b86ca6 LogTimestamp=2021-04-14T13:06:36.233330Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:06:36.234Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:06:36.233Z InvocationID=2c7d7d7f-31e5-42aa-a664-73ee5429da47 LogTimestamp=2021-04-14T13:06:36.234352Z ResponseDesc=OK Exiting. 2021-04-14T13:06:36.234Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:06:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b32e10-1aba-4902-9ee4-42a994a2a78b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b32e10-1aba-4902-9ee4-42a994a2a78b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50b6f175 2021-04-14T13:06:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b32e10-1aba-4902-9ee4-42a994a2a78b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:38.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7b32e10-1aba-4902-9ee4-42a994a2a78b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=935f22a0-95a9-4e3b-850a-da1aaa30c35c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=935f22a0-95a9-4e3b-850a-da1aaa30c35c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@15a235de 2021-04-14T13:06:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=935f22a0-95a9-4e3b-850a-da1aaa30c35c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:41.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=935f22a0-95a9-4e3b-850a-da1aaa30c35c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aa63f4-78b6-4c8f-9fee-20192ddd42da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aa63f4-78b6-4c8f-9fee-20192ddd42da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13a7d780 2021-04-14T13:06:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aa63f4-78b6-4c8f-9fee-20192ddd42da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:45.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69aa63f4-78b6-4c8f-9fee-20192ddd42da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:06:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:06:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=921587e2-7575-4b97-ae34-cd8079b9a7a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=921587e2-7575-4b97-ae34-cd8079b9a7a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48f6b8a3 2021-04-14T13:06:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=921587e2-7575-4b97-ae34-cd8079b9a7a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:47.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=921587e2-7575-4b97-ae34-cd8079b9a7a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e4ac39-d447-4c7e-b567-7af416603adf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e4ac39-d447-4c7e-b567-7af416603adf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f2cc591 2021-04-14T13:06:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e4ac39-d447-4c7e-b567-7af416603adf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:51.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e4ac39-d447-4c7e-b567-7af416603adf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=942f8d6b-97b1-4869-aa7c-1c0f5c7b019b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=942f8d6b-97b1-4869-aa7c-1c0f5c7b019b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b24096f 2021-04-14T13:06:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=942f8d6b-97b1-4869-aa7c-1c0f5c7b019b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:53.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=942f8d6b-97b1-4869-aa7c-1c0f5c7b019b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:56.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28d6b87f-ca87-4d66-9417-7b976fa9a07b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:56.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28d6b87f-ca87-4d66-9417-7b976fa9a07b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@612c05c 2021-04-14T13:06:56.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28d6b87f-ca87-4d66-9417-7b976fa9a07b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:56.909Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28d6b87f-ca87-4d66-9417-7b976fa9a07b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:06:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d57ecd8-81e8-4575-9e7a-fab4ec2d2494 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:06:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d57ecd8-81e8-4575-9e7a-fab4ec2d2494 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b5c539d 2021-04-14T13:06:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d57ecd8-81e8-4575-9e7a-fab4ec2d2494 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:06:59.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d57ecd8-81e8-4575-9e7a-fab4ec2d2494 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:02.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1243787-5943-42e1-a593-789253824c3d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:02.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1243787-5943-42e1-a593-789253824c3d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3215112a 2021-04-14T13:07:02.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1243787-5943-42e1-a593-789253824c3d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:02.919Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f1243787-5943-42e1-a593-789253824c3d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:07:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:07:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:07:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:07:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:07:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:07:06.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4f94a3b-7c78-434e-865f-c3c6917d44f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:06.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4f94a3b-7c78-434e-865f-c3c6917d44f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39710976 2021-04-14T13:07:06.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4f94a3b-7c78-434e-865f-c3c6917d44f5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:06.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4f94a3b-7c78-434e-865f-c3c6917d44f5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:06.230Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f5078f81-9184-4249-8d0c-614c4af72741 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:06.229965Z InvocationID=aac16614-2309-4ff3-a166-c2ff219f005f LogTimestamp=2021-04-14T13:07:06.230011Z Entering 2021-04-14T13:07:06.230Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f5078f81-9184-4249-8d0c-614c4af72741 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:06.229965Z InvocationID=aac16614-2309-4ff3-a166-c2ff219f005f LogTimestamp=2021-04-14T13:07:06.230011Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:07:06.232Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:07:06.230Z InvocationID=94fc3c26-bd8d-4a62-bf03-96b27bfa1402 LogTimestamp=2021-04-14T13:07:06.232317Z ResponseDesc=OK Exiting. 2021-04-14T13:07:06.232Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:07:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43baed02-bd40-42d6-83b4-4f2afef62fea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43baed02-bd40-42d6-83b4-4f2afef62fea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@29f13e24 2021-04-14T13:07:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43baed02-bd40-42d6-83b4-4f2afef62fea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:08.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=43baed02-bd40-42d6-83b4-4f2afef62fea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:11.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33126048-f938-4b82-ac60-11e19ae42194 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:11.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33126048-f938-4b82-ac60-11e19ae42194 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30a8503c 2021-04-14T13:07:11.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33126048-f938-4b82-ac60-11e19ae42194 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:11.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33126048-f938-4b82-ac60-11e19ae42194 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c4d6b8-63f9-4008-887f-ac3255b02758 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c4d6b8-63f9-4008-887f-ac3255b02758 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2aae8b42 2021-04-14T13:07:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c4d6b8-63f9-4008-887f-ac3255b02758 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d3c4d6b8-63f9-4008-887f-ac3255b02758 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:16.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:16.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:17.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=840f44cb-4522-4164-9ec4-289b66d9f9e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:17.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=840f44cb-4522-4164-9ec4-289b66d9f9e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b251dd8 2021-04-14T13:07:17.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=840f44cb-4522-4164-9ec4-289b66d9f9e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:17.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=840f44cb-4522-4164-9ec4-289b66d9f9e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:20.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e514d06a-cf2a-41d2-8d49-ac77d42b9784 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:20.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e514d06a-cf2a-41d2-8d49-ac77d42b9784 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3b050086 2021-04-14T13:07:20.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e514d06a-cf2a-41d2-8d49-ac77d42b9784 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:20.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e514d06a-cf2a-41d2-8d49-ac77d42b9784 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:24.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5342b7-95e0-4e90-b33e-76b104327e62 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:24.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5342b7-95e0-4e90-b33e-76b104327e62 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@495e9e6a 2021-04-14T13:07:24.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5342b7-95e0-4e90-b33e-76b104327e62 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:24.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f5342b7-95e0-4e90-b33e-76b104327e62 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac2091-9ca7-41a5-8d98-560bd317b69c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac2091-9ca7-41a5-8d98-560bd317b69c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1774f898 2021-04-14T13:07:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac2091-9ca7-41a5-8d98-560bd317b69c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49ac2091-9ca7-41a5-8d98-560bd317b69c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c98e95b-9dc0-4141-8502-dc8c59db61ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c98e95b-9dc0-4141-8502-dc8c59db61ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@248cfc73 2021-04-14T13:07:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c98e95b-9dc0-4141-8502-dc8c59db61ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c98e95b-9dc0-4141-8502-dc8c59db61ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d5c41c-168a-4122-9f29-2a372e38dfd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d5c41c-168a-4122-9f29-2a372e38dfd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@379ed954 2021-04-14T13:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d5c41c-168a-4122-9f29-2a372e38dfd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:33.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a2d5c41c-168a-4122-9f29-2a372e38dfd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:35.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd98cbd-0487-4cfb-9ace-06f2d66b975d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:35.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd98cbd-0487-4cfb-9ace-06f2d66b975d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a8eac03 2021-04-14T13:07:35.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd98cbd-0487-4cfb-9ace-06f2d66b975d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:35.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbd98cbd-0487-4cfb-9ace-06f2d66b975d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:36.246Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d2493dba-c25a-47bf-8ad8-4f0b95a5803f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:36.246025Z InvocationID=b1509b74-b08b-4336-9ef0-8b834883046f LogTimestamp=2021-04-14T13:07:36.246152Z Entering 2021-04-14T13:07:36.246Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d2493dba-c25a-47bf-8ad8-4f0b95a5803f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:36.246025Z InvocationID=b1509b74-b08b-4336-9ef0-8b834883046f LogTimestamp=2021-04-14T13:07:36.246152Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:07:36.248Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:07:36.247Z InvocationID=fd73c5a6-79d3-4b7c-af45-a335d046e436 LogTimestamp=2021-04-14T13:07:36.248543Z ResponseDesc=OK Exiting. 2021-04-14T13:07:36.248Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:07:38.352Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=64fe11b4-9673-44cf-92f1-92532529e8ce InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:38.352451Z InvocationID=6a69f2c2-0401-4fef-85b9-ea9efe11fba6 LogTimestamp=2021-04-14T13:07:38.352476Z Entering 2021-04-14T13:07:38.352Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=64fe11b4-9673-44cf-92f1-92532529e8ce InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:38.352451Z InvocationID=6a69f2c2-0401-4fef-85b9-ea9efe11fba6 LogTimestamp=2021-04-14T13:07:38.352476Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:07:38.353Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:07:38.352Z InvocationID=851ba02a-6a63-4a96-a632-5f26826dc4b9 LogTimestamp=2021-04-14T13:07:38.353782Z ResponseDesc=OK Exiting. 2021-04-14T13:07:38.354Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:07:39.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890c55e2-cd71-49b4-93f1-e4baf49b5034 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:39.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890c55e2-cd71-49b4-93f1-e4baf49b5034 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a0e25f2 2021-04-14T13:07:39.005Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890c55e2-cd71-49b4-93f1-e4baf49b5034 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:39.006Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890c55e2-cd71-49b4-93f1-e4baf49b5034 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:41.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b00743e-bb30-45c9-a396-e944f1a4a7b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:41.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b00743e-bb30-45c9-a396-e944f1a4a7b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79a229a4 2021-04-14T13:07:41.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b00743e-bb30-45c9-a396-e944f1a4a7b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:41.585Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b00743e-bb30-45c9-a396-e944f1a4a7b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d242d5-ebe1-486e-a482-b3b58145aebf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d242d5-ebe1-486e-a482-b3b58145aebf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38b71bbd 2021-04-14T13:07:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d242d5-ebe1-486e-a482-b3b58145aebf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:45.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=76d242d5-ebe1-486e-a482-b3b58145aebf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:46.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:46.201Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:07:46.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:07:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6afd36-070c-4ab8-9e11-2b1cd3ee1665 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6afd36-070c-4ab8-9e11-2b1cd3ee1665 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4726561c 2021-04-14T13:07:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6afd36-070c-4ab8-9e11-2b1cd3ee1665 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f6afd36-070c-4ab8-9e11-2b1cd3ee1665 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:48.220Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ed33c5c9-64b3-4773-b9db-e446fab4a2b7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:48.220167Z InvocationID=801d5c04-310b-4e3d-9dbd-3153a28911b3 LogTimestamp=2021-04-14T13:07:48.220192Z Entering 2021-04-14T13:07:48.220Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ed33c5c9-64b3-4773-b9db-e446fab4a2b7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:07:48.220167Z InvocationID=801d5c04-310b-4e3d-9dbd-3153a28911b3 LogTimestamp=2021-04-14T13:07:48.220192Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:07:48.221Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:07:48.220Z InvocationID=7f11a5ab-0c19-490b-be49-e7ad065ecc85 LogTimestamp=2021-04-14T13:07:48.221168Z ResponseDesc=OK Exiting. 2021-04-14T13:07:48.221Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:07:51.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919a309f-f893-4b44-93a0-7d99655b4c37 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:51.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919a309f-f893-4b44-93a0-7d99655b4c37 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@c4cdabf 2021-04-14T13:07:51.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919a309f-f893-4b44-93a0-7d99655b4c37 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:51.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=919a309f-f893-4b44-93a0-7d99655b4c37 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:53.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ec45ab-a54c-485e-af85-4c2672dbc957 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:53.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ec45ab-a54c-485e-af85-4c2672dbc957 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@644b2d9b 2021-04-14T13:07:53.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ec45ab-a54c-485e-af85-4c2672dbc957 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:53.951Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59ec45ab-a54c-485e-af85-4c2672dbc957 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:56.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bb0de5d-3683-4b8e-b972-78707f99565e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:56.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bb0de5d-3683-4b8e-b972-78707f99565e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6421b85c 2021-04-14T13:07:56.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bb0de5d-3683-4b8e-b972-78707f99565e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:56.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6bb0de5d-3683-4b8e-b972-78707f99565e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:07:59.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960853d-e9c6-4ab2-9458-fda830451068 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:07:59.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960853d-e9c6-4ab2-9458-fda830451068 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11429472 2021-04-14T13:07:59.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960853d-e9c6-4ab2-9458-fda830451068 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:07:59.553Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e960853d-e9c6-4ab2-9458-fda830451068 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:02.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a451e62a-94d3-438e-94fe-52a7f30fbc4f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a451e62a-94d3-438e-94fe-52a7f30fbc4f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b313dc7 2021-04-14T13:08:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a451e62a-94d3-438e-94fe-52a7f30fbc4f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:02.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a451e62a-94d3-438e-94fe-52a7f30fbc4f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:08:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:08:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:08:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:08:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:08:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:08:06.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0977f56e-a01b-4acd-8fb0-534ff3de534e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:06.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0977f56e-a01b-4acd-8fb0-534ff3de534e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@462be0cf 2021-04-14T13:08:06.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0977f56e-a01b-4acd-8fb0-534ff3de534e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:06.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0977f56e-a01b-4acd-8fb0-534ff3de534e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:06.222Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3968eaba-8a3a-475c-bdbf-af4c8b03906e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:08:06.222015Z InvocationID=f815577c-49d4-43ff-b3df-2875a1042949 LogTimestamp=2021-04-14T13:08:06.222043Z Entering 2021-04-14T13:08:06.222Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3968eaba-8a3a-475c-bdbf-af4c8b03906e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:08:06.222015Z InvocationID=f815577c-49d4-43ff-b3df-2875a1042949 LogTimestamp=2021-04-14T13:08:06.222043Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:08:06.223Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:08:06.222Z InvocationID=4319d196-914b-4799-b7fe-609d4314a457 LogTimestamp=2021-04-14T13:08:06.223071Z ResponseDesc=OK Exiting. 2021-04-14T13:08:06.223Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:08:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db848fcb-d43e-41bc-b396-2c3863656579 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db848fcb-d43e-41bc-b396-2c3863656579 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fa1530e 2021-04-14T13:08:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db848fcb-d43e-41bc-b396-2c3863656579 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:09.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db848fcb-d43e-41bc-b396-2c3863656579 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52a10ca3-0ee7-4a8f-a2ca-bbd820efbaf2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52a10ca3-0ee7-4a8f-a2ca-bbd820efbaf2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ac5b38c 2021-04-14T13:08:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52a10ca3-0ee7-4a8f-a2ca-bbd820efbaf2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:12.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52a10ca3-0ee7-4a8f-a2ca-bbd820efbaf2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:14.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe2814f-0683-4b5e-b765-df99dd0654a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:14.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe2814f-0683-4b5e-b765-df99dd0654a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58e87c16 2021-04-14T13:08:14.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe2814f-0683-4b5e-b765-df99dd0654a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:14.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fe2814f-0683-4b5e-b765-df99dd0654a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:17.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ad48fef-27f5-45b2-8f3c-08523083ac19 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:17.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ad48fef-27f5-45b2-8f3c-08523083ac19 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41dcc25c 2021-04-14T13:08:17.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ad48fef-27f5-45b2-8f3c-08523083ac19 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:17.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1ad48fef-27f5-45b2-8f3c-08523083ac19 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39fbc94b-ba69-46dd-8e3a-176cc08d9cd3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39fbc94b-ba69-46dd-8e3a-176cc08d9cd3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64c0d04a 2021-04-14T13:08:20.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39fbc94b-ba69-46dd-8e3a-176cc08d9cd3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39fbc94b-ba69-46dd-8e3a-176cc08d9cd3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5125ea2-7833-4fea-b506-6b0db0689ec2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5125ea2-7833-4fea-b506-6b0db0689ec2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@631e568d 2021-04-14T13:08:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5125ea2-7833-4fea-b506-6b0db0689ec2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:24.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5125ea2-7833-4fea-b506-6b0db0689ec2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db842683-4df9-48d8-b659-8ee4e05d3d20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db842683-4df9-48d8-b659-8ee4e05d3d20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@780d8e34 2021-04-14T13:08:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db842683-4df9-48d8-b659-8ee4e05d3d20 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db842683-4df9-48d8-b659-8ee4e05d3d20 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67b7a6a-c031-4f10-b015-aa606794a65b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67b7a6a-c031-4f10-b015-aa606794a65b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f647d4b 2021-04-14T13:08:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67b7a6a-c031-4f10-b015-aa606794a65b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:30.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c67b7a6a-c031-4f10-b015-aa606794a65b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:33.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79269b4c-b426-4202-aa0e-9ead83872e7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:33.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79269b4c-b426-4202-aa0e-9ead83872e7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d44b46d 2021-04-14T13:08:33.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79269b4c-b426-4202-aa0e-9ead83872e7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:33.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79269b4c-b426-4202-aa0e-9ead83872e7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b54e77d-bbff-44c6-86c0-de22f707101e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b54e77d-bbff-44c6-86c0-de22f707101e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cff2776 2021-04-14T13:08:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b54e77d-bbff-44c6-86c0-de22f707101e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:36.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8b54e77d-bbff-44c6-86c0-de22f707101e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:36.236Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2e50edfa-ac04-4293-a305-25a47e8a0256 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:08:36.235809Z InvocationID=8283762f-d831-45f1-897d-50876cd6c65e LogTimestamp=2021-04-14T13:08:36.235868Z Entering 2021-04-14T13:08:36.236Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2e50edfa-ac04-4293-a305-25a47e8a0256 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:08:36.235809Z InvocationID=8283762f-d831-45f1-897d-50876cd6c65e LogTimestamp=2021-04-14T13:08:36.235868Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:08:36.239Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:08:36.236Z InvocationID=2088583c-638e-4d2e-ba5b-8208a2806015 LogTimestamp=2021-04-14T13:08:36.238985Z ResponseDesc=OK Exiting. 2021-04-14T13:08:36.239Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:08:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ee77a9-e50a-4b0b-bdec-49d4e8864fcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ee77a9-e50a-4b0b-bdec-49d4e8864fcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@381770f3 2021-04-14T13:08:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ee77a9-e50a-4b0b-bdec-49d4e8864fcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:39.041Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3ee77a9-e50a-4b0b-bdec-49d4e8864fcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c059a35-f801-48ea-9c7e-13464c1b9026 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c059a35-f801-48ea-9c7e-13464c1b9026 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44e5cc9f 2021-04-14T13:08:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c059a35-f801-48ea-9c7e-13464c1b9026 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c059a35-f801-48ea-9c7e-13464c1b9026 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8076fa82-22a8-4059-98e9-72e5cf2f36f6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8076fa82-22a8-4059-98e9-72e5cf2f36f6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c1aefb2 2021-04-14T13:08:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8076fa82-22a8-4059-98e9-72e5cf2f36f6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8076fa82-22a8-4059-98e9-72e5cf2f36f6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:08:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:08:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f4b04-4f18-4934-a1c2-ac60ea093499 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f4b04-4f18-4934-a1c2-ac60ea093499 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@90ba7d0 2021-04-14T13:08:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f4b04-4f18-4934-a1c2-ac60ea093499 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:47.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a7f4b04-4f18-4934-a1c2-ac60ea093499 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:51.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=022dc123-fb62-495a-8d0f-8fb6fb8dda1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:51.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=022dc123-fb62-495a-8d0f-8fb6fb8dda1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a98deea 2021-04-14T13:08:51.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=022dc123-fb62-495a-8d0f-8fb6fb8dda1a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:51.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=022dc123-fb62-495a-8d0f-8fb6fb8dda1a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6540a934-2011-4b64-afc5-69a1fd54279c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6540a934-2011-4b64-afc5-69a1fd54279c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60f36a12 2021-04-14T13:08:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6540a934-2011-4b64-afc5-69a1fd54279c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:53.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6540a934-2011-4b64-afc5-69a1fd54279c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:56.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c926c4b-3fc7-41b7-a315-a8fe061f3e0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:56.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c926c4b-3fc7-41b7-a315-a8fe061f3e0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b9f6ec1 2021-04-14T13:08:56.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c926c4b-3fc7-41b7-a315-a8fe061f3e0b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:56.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c926c4b-3fc7-41b7-a315-a8fe061f3e0b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:08:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdfdcee8-d911-408a-beac-9016bc0ae35f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:08:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdfdcee8-d911-408a-beac-9016bc0ae35f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ffe6145 2021-04-14T13:08:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdfdcee8-d911-408a-beac-9016bc0ae35f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:08:59.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdfdcee8-d911-408a-beac-9016bc0ae35f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4e2ab0-24b8-467f-91f4-a94a601d367d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4e2ab0-24b8-467f-91f4-a94a601d367d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@735d97de 2021-04-14T13:09:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4e2ab0-24b8-467f-91f4-a94a601d367d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe4e2ab0-24b8-467f-91f4-a94a601d367d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:09:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:09:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:09:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:09:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:09:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:09:06.241Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=aed84a51-6f52-4d96-bd20-27a9b2888e62 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:09:06.241463Z InvocationID=397751b0-5208-45b0-8ef3-06e4ae94efd9 LogTimestamp=2021-04-14T13:09:06.241676Z Entering 2021-04-14T13:09:06.242Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=aed84a51-6f52-4d96-bd20-27a9b2888e62 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:09:06.241463Z InvocationID=397751b0-5208-45b0-8ef3-06e4ae94efd9 LogTimestamp=2021-04-14T13:09:06.241676Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:09:06.244Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:09:06.242Z InvocationID=2f8d8bd9-3826-4d92-b2c5-0f35a42c93f4 LogTimestamp=2021-04-14T13:09:06.243571Z ResponseDesc=OK Exiting. 2021-04-14T13:09:06.244Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:09:06.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57fdc233-0269-45c0-9bf7-8b0f771a22e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:06.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57fdc233-0269-45c0-9bf7-8b0f771a22e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@885c05d 2021-04-14T13:09:06.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57fdc233-0269-45c0-9bf7-8b0f771a22e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:06.496Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57fdc233-0269-45c0-9bf7-8b0f771a22e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:08.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85c5213b-22a3-443e-8612-816101a7d78f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:08.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85c5213b-22a3-443e-8612-816101a7d78f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@187c4eea 2021-04-14T13:09:08.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85c5213b-22a3-443e-8612-816101a7d78f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:08.787Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=85c5213b-22a3-443e-8612-816101a7d78f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:12.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e873008c-2fd3-451e-b526-e05fbc0c7a5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:12.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e873008c-2fd3-451e-b526-e05fbc0c7a5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54c4f0e9 2021-04-14T13:09:12.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e873008c-2fd3-451e-b526-e05fbc0c7a5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:12.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e873008c-2fd3-451e-b526-e05fbc0c7a5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:14.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94541435-a3f5-4d0f-ba2a-e408feff4d46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:14.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94541435-a3f5-4d0f-ba2a-e408feff4d46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bb87ec8 2021-04-14T13:09:14.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94541435-a3f5-4d0f-ba2a-e408feff4d46 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:14.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94541435-a3f5-4d0f-ba2a-e408feff4d46 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:17.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f7d3efa-217e-41f1-b340-2f4084299321 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:17.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f7d3efa-217e-41f1-b340-2f4084299321 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d19c8ca 2021-04-14T13:09:17.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f7d3efa-217e-41f1-b340-2f4084299321 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:17.854Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f7d3efa-217e-41f1-b340-2f4084299321 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b019c94d-3826-4f3c-b571-2c565f925cc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b019c94d-3826-4f3c-b571-2c565f925cc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17e8c09d 2021-04-14T13:09:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b019c94d-3826-4f3c-b571-2c565f925cc7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b019c94d-3826-4f3c-b571-2c565f925cc7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:24.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0076a7-68cd-4fcf-9ed6-7059ec387529 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:24.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0076a7-68cd-4fcf-9ed6-7059ec387529 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64d83931 2021-04-14T13:09:24.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0076a7-68cd-4fcf-9ed6-7059ec387529 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:24.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c0076a7-68cd-4fcf-9ed6-7059ec387529 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28ff97b4-7389-4dfe-b69b-798c065dd031 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28ff97b4-7389-4dfe-b69b-798c065dd031 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c9e455c 2021-04-14T13:09:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28ff97b4-7389-4dfe-b69b-798c065dd031 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28ff97b4-7389-4dfe-b69b-798c065dd031 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb3373f-8186-45fc-9369-7fb7a993a848 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb3373f-8186-45fc-9369-7fb7a993a848 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fe28f9d 2021-04-14T13:09:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb3373f-8186-45fc-9369-7fb7a993a848 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:29.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3eb3373f-8186-45fc-9369-7fb7a993a848 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:33.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1be5ac-0b1c-462b-9a30-78e669dbf873 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:33.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1be5ac-0b1c-462b-9a30-78e669dbf873 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e5f42d4 2021-04-14T13:09:33.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1be5ac-0b1c-462b-9a30-78e669dbf873 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:33.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed1be5ac-0b1c-462b-9a30-78e669dbf873 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:35.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe714b89-8ff8-4f9c-910c-ff6b1f603077 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:35.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe714b89-8ff8-4f9c-910c-ff6b1f603077 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3bebe19f 2021-04-14T13:09:35.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe714b89-8ff8-4f9c-910c-ff6b1f603077 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:35.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe714b89-8ff8-4f9c-910c-ff6b1f603077 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:36.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fa52f656-f90f-4996-82fe-637fb6c30bd2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:09:36.234915Z InvocationID=95fc2abc-5303-4d0e-aa09-bb1da4342251 LogTimestamp=2021-04-14T13:09:36.235020Z Entering 2021-04-14T13:09:36.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fa52f656-f90f-4996-82fe-637fb6c30bd2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:09:36.234915Z InvocationID=95fc2abc-5303-4d0e-aa09-bb1da4342251 LogTimestamp=2021-04-14T13:09:36.235020Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:09:36.238Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:09:36.236Z InvocationID=b6fc3485-55aa-418b-b1ee-2ec223a25ff7 LogTimestamp=2021-04-14T13:09:36.238500Z ResponseDesc=OK Exiting. 2021-04-14T13:09:36.238Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:09:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cf65696-f47b-49d9-a70f-448eb123d868 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cf65696-f47b-49d9-a70f-448eb123d868 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25c1e71b 2021-04-14T13:09:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cf65696-f47b-49d9-a70f-448eb123d868 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cf65696-f47b-49d9-a70f-448eb123d868 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165c794b-0f20-42b2-a7fe-5072584be0fb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165c794b-0f20-42b2-a7fe-5072584be0fb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e041a59 2021-04-14T13:09:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165c794b-0f20-42b2-a7fe-5072584be0fb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=165c794b-0f20-42b2-a7fe-5072584be0fb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:45.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e165201c-bdfd-405e-b90d-6ddb89e90832 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:45.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e165201c-bdfd-405e-b90d-6ddb89e90832 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1aa9beaf 2021-04-14T13:09:45.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e165201c-bdfd-405e-b90d-6ddb89e90832 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:45.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e165201c-bdfd-405e-b90d-6ddb89e90832 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:09:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:09:48.089Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a04909-95f9-4e98-91b0-fce6012a5eb4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:48.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a04909-95f9-4e98-91b0-fce6012a5eb4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7eaa537c 2021-04-14T13:09:48.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a04909-95f9-4e98-91b0-fce6012a5eb4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:48.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50a04909-95f9-4e98-91b0-fce6012a5eb4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:48.215Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ae85c791-58af-416c-93a0-81b18b929de9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:09:48.214866Z InvocationID=205f5b20-3928-49d7-ad7c-20f5931d3e50 LogTimestamp=2021-04-14T13:09:48.214929Z Entering 2021-04-14T13:09:48.215Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ae85c791-58af-416c-93a0-81b18b929de9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:09:48.214866Z InvocationID=205f5b20-3928-49d7-ad7c-20f5931d3e50 LogTimestamp=2021-04-14T13:09:48.214929Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:09:48.218Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:09:48.216Z InvocationID=e6d141ee-4e9f-465a-bc5a-2fa368dc31cc LogTimestamp=2021-04-14T13:09:48.218714Z ResponseDesc=OK Exiting. 2021-04-14T13:09:48.219Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:09:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4935c5e4-23c2-4278-83af-a86cc8582f59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4935c5e4-23c2-4278-83af-a86cc8582f59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54799a8d 2021-04-14T13:09:51.218Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4935c5e4-23c2-4278-83af-a86cc8582f59 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:51.219Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4935c5e4-23c2-4278-83af-a86cc8582f59 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:53.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd304b93-5114-4cd3-94f4-aaf21f80a399 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:53.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd304b93-5114-4cd3-94f4-aaf21f80a399 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@af19489 2021-04-14T13:09:53.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd304b93-5114-4cd3-94f4-aaf21f80a399 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:53.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd304b93-5114-4cd3-94f4-aaf21f80a399 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:56.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e88656a-41f6-4055-a6fb-c96522264829 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:56.895Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e88656a-41f6-4055-a6fb-c96522264829 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d7a0fbe 2021-04-14T13:09:56.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e88656a-41f6-4055-a6fb-c96522264829 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:56.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e88656a-41f6-4055-a6fb-c96522264829 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:09:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c811d21e-f91d-4c44-a0de-9052165b7a5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:09:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c811d21e-f91d-4c44-a0de-9052165b7a5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@716796de 2021-04-14T13:09:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c811d21e-f91d-4c44-a0de-9052165b7a5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:09:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c811d21e-f91d-4c44-a0de-9052165b7a5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:02.828Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8e7e0ea-4a48-4adf-8231-ee7c9543725f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:02.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8e7e0ea-4a48-4adf-8231-ee7c9543725f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6952d78d 2021-04-14T13:10:02.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8e7e0ea-4a48-4adf-8231-ee7c9543725f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:02.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8e7e0ea-4a48-4adf-8231-ee7c9543725f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:10:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:10:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:10:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:10:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:10:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:10:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4409b58-1b12-479b-bd1f-9a48f8851cba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4409b58-1b12-479b-bd1f-9a48f8851cba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f8153f2 2021-04-14T13:10:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4409b58-1b12-479b-bd1f-9a48f8851cba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:05.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4409b58-1b12-479b-bd1f-9a48f8851cba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:06.238Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3b7e7b86-fc81-4762-9e9d-60256cfd45a3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:06.238687Z InvocationID=7da41bca-9d07-4210-81d1-5d572c93761d LogTimestamp=2021-04-14T13:10:06.238753Z Entering 2021-04-14T13:10:06.239Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3b7e7b86-fc81-4762-9e9d-60256cfd45a3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:06.238687Z InvocationID=7da41bca-9d07-4210-81d1-5d572c93761d LogTimestamp=2021-04-14T13:10:06.238753Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:10:06.241Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:10:06.239Z InvocationID=e4037319-40ca-4342-89d8-31e0180ebd27 LogTimestamp=2021-04-14T13:10:06.240986Z ResponseDesc=OK Exiting. 2021-04-14T13:10:06.241Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:10:09.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5091b2-5d05-4a95-8a1f-8da986e332a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:09.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5091b2-5d05-4a95-8a1f-8da986e332a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@628bb643 2021-04-14T13:10:09.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5091b2-5d05-4a95-8a1f-8da986e332a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:09.105Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cd5091b2-5d05-4a95-8a1f-8da986e332a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:11.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d93f97-544f-4c3f-a2e4-456d0ade94fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:11.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d93f97-544f-4c3f-a2e4-456d0ade94fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f971daa 2021-04-14T13:10:11.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d93f97-544f-4c3f-a2e4-456d0ade94fc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:11.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=87d93f97-544f-4c3f-a2e4-456d0ade94fc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=352610b5-ed74-4673-be44-5de447f1557c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=352610b5-ed74-4673-be44-5de447f1557c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5086496a 2021-04-14T13:10:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=352610b5-ed74-4673-be44-5de447f1557c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:14.809Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=352610b5-ed74-4673-be44-5de447f1557c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:18.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5539279f-2a00-4999-ab5d-aee56d1f8823 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:18.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5539279f-2a00-4999-ab5d-aee56d1f8823 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@357d8e4b 2021-04-14T13:10:18.197Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5539279f-2a00-4999-ab5d-aee56d1f8823 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:18.198Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5539279f-2a00-4999-ab5d-aee56d1f8823 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c4e07d-db17-42e1-a9bc-c19e078bb4ce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c4e07d-db17-42e1-a9bc-c19e078bb4ce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@afb1f09 2021-04-14T13:10:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c4e07d-db17-42e1-a9bc-c19e078bb4ce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:20.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99c4e07d-db17-42e1-a9bc-c19e078bb4ce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:23.141Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a71d7fb9-a5f5-4729-98c7-165a1c1ca1a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:23.141725Z InvocationID=8f638ed7-2125-4594-9364-499f8e203048 LogTimestamp=2021-04-14T13:10:23.141784Z Entering 2021-04-14T13:10:23.142Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a71d7fb9-a5f5-4729-98c7-165a1c1ca1a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:23.141725Z InvocationID=8f638ed7-2125-4594-9364-499f8e203048 LogTimestamp=2021-04-14T13:10:23.141784Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:10:23.143Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:10:23.142Z InvocationID=2bf490f2-d68c-4eb8-8e0a-bc9866b2587c LogTimestamp=2021-04-14T13:10:23.143160Z ResponseDesc=OK Exiting. 2021-04-14T13:10:23.143Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:10:24.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c249f9-4e46-46c2-bfe1-b3e92027a6e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:24.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c249f9-4e46-46c2-bfe1-b3e92027a6e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d1639b1 2021-04-14T13:10:24.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c249f9-4e46-46c2-bfe1-b3e92027a6e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:24.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69c249f9-4e46-46c2-bfe1-b3e92027a6e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:26.013Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c09989e9-e4d3-47dc-8a67-e921431a51ae InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:26.013158Z InvocationID=0fc3bffb-4d40-418c-9d37-a6a66e57a540 LogTimestamp=2021-04-14T13:10:26.013201Z Entering 2021-04-14T13:10:26.013Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c09989e9-e4d3-47dc-8a67-e921431a51ae InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:26.013158Z InvocationID=0fc3bffb-4d40-418c-9d37-a6a66e57a540 LogTimestamp=2021-04-14T13:10:26.013201Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:10:26.014Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:10:26.013Z InvocationID=8b0914c0-f867-4ff6-bd18-8ea713e6e2c3 LogTimestamp=2021-04-14T13:10:26.014447Z ResponseDesc=OK Exiting. 2021-04-14T13:10:26.014Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:10:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31173779-e23e-4cdd-b198-242865e0694d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31173779-e23e-4cdd-b198-242865e0694d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f39ee60 2021-04-14T13:10:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31173779-e23e-4cdd-b198-242865e0694d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:27.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31173779-e23e-4cdd-b198-242865e0694d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:29.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b2b83c3-2c2c-4e3a-a497-1839c8f2da05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:29.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b2b83c3-2c2c-4e3a-a497-1839c8f2da05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26ef281a 2021-04-14T13:10:29.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b2b83c3-2c2c-4e3a-a497-1839c8f2da05 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:29.926Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b2b83c3-2c2c-4e3a-a497-1839c8f2da05 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2663bf2f-af13-4573-a6c7-45fbe4f4ba64 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2663bf2f-af13-4573-a6c7-45fbe4f4ba64 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74be7899 2021-04-14T13:10:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2663bf2f-af13-4573-a6c7-45fbe4f4ba64 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2663bf2f-af13-4573-a6c7-45fbe4f4ba64 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:34.633Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07bp7rwp7gx8cgblk69791q07440 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node012rmgaa8jvxwdpl3zmrt81kxn407 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01d7m1r050u5u81ndupdvbt2kdc402 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01safn9o5obfi51wp5nf822kz6i408 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01khq8focadvg312bej60xwtlvd427 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0s7gqych3kbdn1j1kj5lwe2x04411 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ax66itp62sit8wnbve2yb01e421 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06frmbe4a96d511wmnhyo1ryp1405 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ej8yrh03l01o128kf7kyux14401 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dbmo2e3i5p5ueoakx61w90q1420 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ir617ogbisr51ntxo53k72i7r438 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bvcbwufajdgt1b576sg9w0ir9412 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0jj25f74yknou7lzs2ks1x65i432 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ofkkx3pcek1ht233r6832c11410 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01jtdjfkmorfx5u1cdmeq7mhlt403 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xbylsg34ju511vu13f7m5e0z3436 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01trhwwr7bfffh1lyaajc7jkstc428 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xt57c0npioni2r27v5cztdmp423 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ai1bvnooi9gu1hu9px05d2xed415 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0unj9z7hkgmtzn5rc0qi0hr3u419 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0shv5dvtyga1rkr148if06rw0430 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ijs0g596thaaqj43i657vj12400 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01d6z12wjywm1qxowx0fuy4v1n416 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0cw2of1rawugq1mer7rx266nx417 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bpbpbyslk5we1gbpj6c0ehtlu413 2021-04-14T13:10:34.634Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01e3a9qanark1v1mg9yti3cibfr418 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0w2an36pd6u85khcc0t0ufe6p437 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0cojltrzi5e9s1qeooxobv50hd422 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vwjo9o7402iv1qlodp4j7m271439 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01mexj1yh66cgy1tomjv7pywyhm414 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016od9rqjky8rt1jqsnvdu7e307406 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yv0xff0uc1w8e05cjr7u95ez435 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01s9dyzfyqrzxh1uhohuax9gf18433 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0biwnr0v5tubuyau64y3y2gzj425 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010ak2inwydf2n24igtl6kj4ao404 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node05dji17wdrp2owlpnny2p6i9h431 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09235469wsz4trzk6tpitztp3409 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node015ky22rtpon1t1e21z8cop4eqm424 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010s5qv32bth2b3lt8ei7bxwoz426 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dkr5nfiw8fnn14q88wzcgm47i434 2021-04-14T13:10:34.635Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01tr8iwn7gw3ltg9yip49irgzk429 2021-04-14T13:10:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35c8dfec-e016-4bae-acbd-e2ec8fb6a2ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35c8dfec-e016-4bae-acbd-e2ec8fb6a2ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58c91c0e 2021-04-14T13:10:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35c8dfec-e016-4bae-acbd-e2ec8fb6a2ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:36.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35c8dfec-e016-4bae-acbd-e2ec8fb6a2ac PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:36.218Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e0858a94-98fd-4fac-9a6e-6c33688447e4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:36.217870Z InvocationID=5c92c1ff-1634-4590-a4b0-d6097c6be715 LogTimestamp=2021-04-14T13:10:36.217906Z Entering 2021-04-14T13:10:36.218Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e0858a94-98fd-4fac-9a6e-6c33688447e4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:10:36.217870Z InvocationID=5c92c1ff-1634-4590-a4b0-d6097c6be715 LogTimestamp=2021-04-14T13:10:36.217906Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:10:36.219Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:10:36.218Z InvocationID=7ed8df62-39af-4cba-8522-1de10dcf8937 LogTimestamp=2021-04-14T13:10:36.219339Z ResponseDesc=OK Exiting. 2021-04-14T13:10:36.219Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:10:38.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d582505d-5cca-451f-816b-2c4252717db6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:38.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d582505d-5cca-451f-816b-2c4252717db6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68b3a399 2021-04-14T13:10:38.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d582505d-5cca-451f-816b-2c4252717db6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:38.749Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d582505d-5cca-451f-816b-2c4252717db6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d391d33-fd58-4e07-8d55-cd5d79c9fc81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d391d33-fd58-4e07-8d55-cd5d79c9fc81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3743e96d 2021-04-14T13:10:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d391d33-fd58-4e07-8d55-cd5d79c9fc81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d391d33-fd58-4e07-8d55-cd5d79c9fc81 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e8af4d-82f7-45d8-86e8-b2904597347a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e8af4d-82f7-45d8-86e8-b2904597347a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30be35ac 2021-04-14T13:10:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e8af4d-82f7-45d8-86e8-b2904597347a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:45.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e3e8af4d-82f7-45d8-86e8-b2904597347a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:10:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:10:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bd80b9-9c7a-4c1a-9732-19f56ebe01c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bd80b9-9c7a-4c1a-9732-19f56ebe01c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@200776d9 2021-04-14T13:10:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bd80b9-9c7a-4c1a-9732-19f56ebe01c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=52bd80b9-9c7a-4c1a-9732-19f56ebe01c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:51.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd023a19-08b8-40c9-8bd4-9552194d1f0d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:51.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd023a19-08b8-40c9-8bd4-9552194d1f0d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55dda62b 2021-04-14T13:10:51.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd023a19-08b8-40c9-8bd4-9552194d1f0d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:51.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd023a19-08b8-40c9-8bd4-9552194d1f0d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:53.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19be5204-f459-404a-b1e4-d18548268bb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19be5204-f459-404a-b1e4-d18548268bb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d7d357c 2021-04-14T13:10:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19be5204-f459-404a-b1e4-d18548268bb1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19be5204-f459-404a-b1e4-d18548268bb1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:57.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850fde07-e323-4210-8e8f-ea8ee9382347 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:57.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850fde07-e323-4210-8e8f-ea8ee9382347 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3caf7c2a 2021-04-14T13:10:57.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850fde07-e323-4210-8e8f-ea8ee9382347 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:57.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=850fde07-e323-4210-8e8f-ea8ee9382347 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:10:59.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d71224ac-00bb-4b9b-b8e4-08186b3ba97e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:10:59.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d71224ac-00bb-4b9b-b8e4-08186b3ba97e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@278564d8 2021-04-14T13:10:59.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d71224ac-00bb-4b9b-b8e4-08186b3ba97e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:10:59.530Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d71224ac-00bb-4b9b-b8e4-08186b3ba97e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:03.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a663f4f-a885-4f39-a313-c9da7201a67c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:03.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a663f4f-a885-4f39-a313-c9da7201a67c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f5172fd 2021-04-14T13:11:03.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a663f4f-a885-4f39-a313-c9da7201a67c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:03.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a663f4f-a885-4f39-a313-c9da7201a67c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:11:04.352Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:11:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:11:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:11:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:11:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:11:06.186Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bf85e1-e53f-4ea2-855c-67fd0a739800 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:06.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bf85e1-e53f-4ea2-855c-67fd0a739800 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b1372be 2021-04-14T13:11:06.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bf85e1-e53f-4ea2-855c-67fd0a739800 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:06.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3bf85e1-e53f-4ea2-855c-67fd0a739800 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:06.238Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0fb184de-e727-4d2e-95b5-a8041b4169b1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:11:06.237695Z InvocationID=c5fce0dc-1d56-4c21-afa7-6258ac606cb0 LogTimestamp=2021-04-14T13:11:06.237797Z Entering 2021-04-14T13:11:06.238Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0fb184de-e727-4d2e-95b5-a8041b4169b1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:11:06.237695Z InvocationID=c5fce0dc-1d56-4c21-afa7-6258ac606cb0 LogTimestamp=2021-04-14T13:11:06.237797Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:11:06.244Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=6 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:11:06.238Z InvocationID=e1bf9858-9a62-4d38-aebd-fdf8b59bd094 LogTimestamp=2021-04-14T13:11:06.244472Z ResponseDesc=OK Exiting. 2021-04-14T13:11:06.244Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:11:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c682fc82-b419-4712-b92a-f2752dd9f7c1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c682fc82-b419-4712-b92a-f2752dd9f7c1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c9a01da 2021-04-14T13:11:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c682fc82-b419-4712-b92a-f2752dd9f7c1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:08.989Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c682fc82-b419-4712-b92a-f2752dd9f7c1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:12.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4174574-8a76-4d2b-ab08-590bc3956f9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:12.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4174574-8a76-4d2b-ab08-590bc3956f9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40350f35 2021-04-14T13:11:12.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4174574-8a76-4d2b-ab08-590bc3956f9f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:12.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f4174574-8a76-4d2b-ab08-590bc3956f9f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:14.699Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e55ce-dc2f-47f9-98b6-75acc13cffb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:14.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e55ce-dc2f-47f9-98b6-75acc13cffb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54675b54 2021-04-14T13:11:14.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e55ce-dc2f-47f9-98b6-75acc13cffb3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:14.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=954e55ce-dc2f-47f9-98b6-75acc13cffb3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:17.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d32a2b-c27c-49c6-a0ff-28faac5c4165 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:17.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d32a2b-c27c-49c6-a0ff-28faac5c4165 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44f145e4 2021-04-14T13:11:17.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d32a2b-c27c-49c6-a0ff-28faac5c4165 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:17.791Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99d32a2b-c27c-49c6-a0ff-28faac5c4165 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:20.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc3aa1a0-1282-46e0-aaeb-2d6db46ecb22 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc3aa1a0-1282-46e0-aaeb-2d6db46ecb22 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58f91871 2021-04-14T13:11:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc3aa1a0-1282-46e0-aaeb-2d6db46ecb22 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc3aa1a0-1282-46e0-aaeb-2d6db46ecb22 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c18d4ea-5c11-4960-8d0c-dbc6c9741208 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c18d4ea-5c11-4960-8d0c-dbc6c9741208 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@305df8fc 2021-04-14T13:11:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c18d4ea-5c11-4960-8d0c-dbc6c9741208 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:24.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0c18d4ea-5c11-4960-8d0c-dbc6c9741208 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:27.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c72c66-8358-4034-ba4e-7a937215309c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c72c66-8358-4034-ba4e-7a937215309c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e0ea858 2021-04-14T13:11:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c72c66-8358-4034-ba4e-7a937215309c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55c72c66-8358-4034-ba4e-7a937215309c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ea49bb6-5864-43f2-8203-ea5361fdd2e7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ea49bb6-5864-43f2-8203-ea5361fdd2e7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@109e1818 2021-04-14T13:11:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ea49bb6-5864-43f2-8203-ea5361fdd2e7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ea49bb6-5864-43f2-8203-ea5361fdd2e7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:33.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfb69ddd-7bf7-4820-b9c3-f85c17314be9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:33.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfb69ddd-7bf7-4820-b9c3-f85c17314be9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34b0ea 2021-04-14T13:11:33.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfb69ddd-7bf7-4820-b9c3-f85c17314be9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:33.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dfb69ddd-7bf7-4820-b9c3-f85c17314be9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f03ba3d6-7f81-4000-a39d-3b2c90c458f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f03ba3d6-7f81-4000-a39d-3b2c90c458f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ff12208 2021-04-14T13:11:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f03ba3d6-7f81-4000-a39d-3b2c90c458f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:35.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f03ba3d6-7f81-4000-a39d-3b2c90c458f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:36.236Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c6971331-c6dd-4258-9830-4619c9a4bf6a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:11:36.235845Z InvocationID=7686e0e4-1121-40ba-a9cf-e97a07670daa LogTimestamp=2021-04-14T13:11:36.235906Z Entering 2021-04-14T13:11:36.236Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c6971331-c6dd-4258-9830-4619c9a4bf6a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:11:36.235845Z InvocationID=7686e0e4-1121-40ba-a9cf-e97a07670daa LogTimestamp=2021-04-14T13:11:36.235906Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:11:36.238Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:11:36.236Z InvocationID=14ec7918-543b-4431-a5ca-60791d873dae LogTimestamp=2021-04-14T13:11:36.238203Z ResponseDesc=OK Exiting. 2021-04-14T13:11:36.238Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:11:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea6f3d2-c85e-4cd8-ab5d-11c047e77e77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea6f3d2-c85e-4cd8-ab5d-11c047e77e77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@74961dc6 2021-04-14T13:11:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea6f3d2-c85e-4cd8-ab5d-11c047e77e77 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:38.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9ea6f3d2-c85e-4cd8-ab5d-11c047e77e77 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:41.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7999816-22dd-4d78-bc84-5a68351f2f72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:41.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7999816-22dd-4d78-bc84-5a68351f2f72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14288594 2021-04-14T13:11:41.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7999816-22dd-4d78-bc84-5a68351f2f72 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:41.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7999816-22dd-4d78-bc84-5a68351f2f72 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:45.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e558bdf7-561e-4004-a52a-1aeaeee05ea6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:45.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e558bdf7-561e-4004-a52a-1aeaeee05ea6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31bed41b 2021-04-14T13:11:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e558bdf7-561e-4004-a52a-1aeaeee05ea6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e558bdf7-561e-4004-a52a-1aeaeee05ea6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:11:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:11:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3900d16f-81e3-4650-9e56-2ec3a1a26c17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3900d16f-81e3-4650-9e56-2ec3a1a26c17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67095146 2021-04-14T13:11:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3900d16f-81e3-4650-9e56-2ec3a1a26c17 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:47.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3900d16f-81e3-4650-9e56-2ec3a1a26c17 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:48.247Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1e53a8f9-8080-494f-9da1-c494ff331d3d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:11:48.247431Z InvocationID=4f0da2f8-755d-4c91-8834-aca5f10e07e0 LogTimestamp=2021-04-14T13:11:48.247466Z Entering 2021-04-14T13:11:48.247Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1e53a8f9-8080-494f-9da1-c494ff331d3d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:11:48.247431Z InvocationID=4f0da2f8-755d-4c91-8834-aca5f10e07e0 LogTimestamp=2021-04-14T13:11:48.247466Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:11:48.248Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:11:48.247Z InvocationID=92fdf710-6067-4154-8f29-07cb1d22e96c LogTimestamp=2021-04-14T13:11:48.248702Z ResponseDesc=OK Exiting. 2021-04-14T13:11:48.248Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:11:51.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7858309c-1ddb-42cb-9629-42a1853bca29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:51.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7858309c-1ddb-42cb-9629-42a1853bca29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2335084c 2021-04-14T13:11:51.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7858309c-1ddb-42cb-9629-42a1853bca29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:51.230Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7858309c-1ddb-42cb-9629-42a1853bca29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:53.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344a09fe-f928-4d12-80ec-f84cad0e4c48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:53.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344a09fe-f928-4d12-80ec-f84cad0e4c48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73612d9b 2021-04-14T13:11:53.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344a09fe-f928-4d12-80ec-f84cad0e4c48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:53.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=344a09fe-f928-4d12-80ec-f84cad0e4c48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:57.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f08f64f9-9816-4642-84bf-3c6446c31462 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:57.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f08f64f9-9816-4642-84bf-3c6446c31462 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34b831e0 2021-04-14T13:11:57.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f08f64f9-9816-4642-84bf-3c6446c31462 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:57.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f08f64f9-9816-4642-84bf-3c6446c31462 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:11:59.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf57e51-d2d4-4a1a-982f-2ca0214cdd1e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:11:59.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf57e51-d2d4-4a1a-982f-2ca0214cdd1e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1916c550 2021-04-14T13:11:59.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf57e51-d2d4-4a1a-982f-2ca0214cdd1e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:11:59.523Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccf57e51-d2d4-4a1a-982f-2ca0214cdd1e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c624004a-6575-4807-bd76-282fe18c322a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c624004a-6575-4807-bd76-282fe18c322a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@12eac956 2021-04-14T13:12:02.726Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c624004a-6575-4807-bd76-282fe18c322a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:02.727Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c624004a-6575-4807-bd76-282fe18c322a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:12:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:12:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:12:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:12:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:12:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:12:06.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=925a3956-cc75-4412-a296-6531b342a9ae InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:12:06.235220Z InvocationID=97ffd85e-60c1-4a9d-941f-07ea205ba798 LogTimestamp=2021-04-14T13:12:06.235280Z Entering 2021-04-14T13:12:06.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=925a3956-cc75-4412-a296-6531b342a9ae InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:12:06.235220Z InvocationID=97ffd85e-60c1-4a9d-941f-07ea205ba798 LogTimestamp=2021-04-14T13:12:06.235280Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:12:06.237Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:12:06.235Z InvocationID=942e7199-0c40-4288-8520-a788f877544c LogTimestamp=2021-04-14T13:12:06.237811Z ResponseDesc=OK Exiting. 2021-04-14T13:12:06.238Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:12:06.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2a5076-8e11-4e5a-ad93-6aff49b8f3fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:06.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2a5076-8e11-4e5a-ad93-6aff49b8f3fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@689d3365 2021-04-14T13:12:06.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2a5076-8e11-4e5a-ad93-6aff49b8f3fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:06.313Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c2a5076-8e11-4e5a-ad93-6aff49b8f3fe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69a8a386-75f7-4b01-96bb-991a2746b8af PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69a8a386-75f7-4b01-96bb-991a2746b8af PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ddf38a7 2021-04-14T13:12:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69a8a386-75f7-4b01-96bb-991a2746b8af PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:09.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=69a8a386-75f7-4b01-96bb-991a2746b8af PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=812e0d39-0e1f-4014-b47d-8eb793f62e47 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=812e0d39-0e1f-4014-b47d-8eb793f62e47 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32cc4209 2021-04-14T13:12:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=812e0d39-0e1f-4014-b47d-8eb793f62e47 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:11.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=812e0d39-0e1f-4014-b47d-8eb793f62e47 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:14.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da110ee9-8868-4daa-996e-8ccc4cdc13d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:14.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da110ee9-8868-4daa-996e-8ccc4cdc13d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76289d7f 2021-04-14T13:12:14.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da110ee9-8868-4daa-996e-8ccc4cdc13d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:14.790Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=da110ee9-8868-4daa-996e-8ccc4cdc13d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:16.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:16.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142076c7-6ac2-4ef9-91d1-9e361dad3809 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142076c7-6ac2-4ef9-91d1-9e361dad3809 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77af8ec4 2021-04-14T13:12:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142076c7-6ac2-4ef9-91d1-9e361dad3809 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:18.095Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=142076c7-6ac2-4ef9-91d1-9e361dad3809 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20bd6c73-255f-42df-9322-c5e2f7cc0d1b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20bd6c73-255f-42df-9322-c5e2f7cc0d1b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13518a96 2021-04-14T13:12:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20bd6c73-255f-42df-9322-c5e2f7cc0d1b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:20.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=20bd6c73-255f-42df-9322-c5e2f7cc0d1b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:23.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff924484-393c-4cce-b505-54a4528cbf06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:23.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff924484-393c-4cce-b505-54a4528cbf06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43dd5eff 2021-04-14T13:12:23.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff924484-393c-4cce-b505-54a4528cbf06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:23.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ff924484-393c-4cce-b505-54a4528cbf06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f56268-60a4-49c8-87da-1108e76caa55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f56268-60a4-49c8-87da-1108e76caa55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@712cf09e 2021-04-14T13:12:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f56268-60a4-49c8-87da-1108e76caa55 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f56268-60a4-49c8-87da-1108e76caa55 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dd0b2f0-00dd-4d12-a921-8552749d4930 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dd0b2f0-00dd-4d12-a921-8552749d4930 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a7e89d1 2021-04-14T13:12:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dd0b2f0-00dd-4d12-a921-8552749d4930 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9dd0b2f0-00dd-4d12-a921-8552749d4930 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b89df000-7898-4e3b-bb81-3fa5a8107f71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b89df000-7898-4e3b-bb81-3fa5a8107f71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65e4a932 2021-04-14T13:12:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b89df000-7898-4e3b-bb81-3fa5a8107f71 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b89df000-7898-4e3b-bb81-3fa5a8107f71 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:35.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc2a0ca-6300-4fbc-b7ba-e9f8375dd221 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:35.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc2a0ca-6300-4fbc-b7ba-e9f8375dd221 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c6729d7 2021-04-14T13:12:35.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc2a0ca-6300-4fbc-b7ba-e9f8375dd221 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:35.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcc2a0ca-6300-4fbc-b7ba-e9f8375dd221 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:36.217Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=36e72931-00af-4ec1-aa0d-f443783501f3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:12:36.217579Z InvocationID=015747c8-7865-4a4f-8372-ec3ea2ca63cb LogTimestamp=2021-04-14T13:12:36.217647Z Entering 2021-04-14T13:12:36.218Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=36e72931-00af-4ec1-aa0d-f443783501f3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:12:36.217579Z InvocationID=015747c8-7865-4a4f-8372-ec3ea2ca63cb LogTimestamp=2021-04-14T13:12:36.217647Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:12:36.219Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:12:36.218Z InvocationID=6ca24c53-8c66-4d6f-93b3-d21fbb1f32ad LogTimestamp=2021-04-14T13:12:36.219679Z ResponseDesc=OK Exiting. 2021-04-14T13:12:36.219Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:12:38.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b38921ff-2b87-429d-aaf5-dc0dcb0fbcc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:38.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b38921ff-2b87-429d-aaf5-dc0dcb0fbcc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ad998c5 2021-04-14T13:12:38.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b38921ff-2b87-429d-aaf5-dc0dcb0fbcc5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:38.946Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b38921ff-2b87-429d-aaf5-dc0dcb0fbcc5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:41.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3e4c00-cdc6-4065-bb2a-6a7fcde0a9f7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:41.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3e4c00-cdc6-4065-bb2a-6a7fcde0a9f7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54e7b24e 2021-04-14T13:12:41.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3e4c00-cdc6-4065-bb2a-6a7fcde0a9f7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:41.526Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b3e4c00-cdc6-4065-bb2a-6a7fcde0a9f7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca2b56d-7231-41d6-bec2-fb07de70e2be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca2b56d-7231-41d6-bec2-fb07de70e2be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@140a3cd9 2021-04-14T13:12:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca2b56d-7231-41d6-bec2-fb07de70e2be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8ca2b56d-7231-41d6-bec2-fb07de70e2be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:12:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:12:47.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc977225-8b87-49f7-a772-1d814516ec29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:47.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc977225-8b87-49f7-a772-1d814516ec29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61d6961e 2021-04-14T13:12:47.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc977225-8b87-49f7-a772-1d814516ec29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:47.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc977225-8b87-49f7-a772-1d814516ec29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e809b81a-ef61-4bd4-ac94-5ffcf24dcd7d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e809b81a-ef61-4bd4-ac94-5ffcf24dcd7d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77df3551 2021-04-14T13:12:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e809b81a-ef61-4bd4-ac94-5ffcf24dcd7d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:51.138Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e809b81a-ef61-4bd4-ac94-5ffcf24dcd7d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d5eb3e9-bf17-4c14-b43d-2ece4c9ecb1d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d5eb3e9-bf17-4c14-b43d-2ece4c9ecb1d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e438c26 2021-04-14T13:12:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d5eb3e9-bf17-4c14-b43d-2ece4c9ecb1d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:53.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d5eb3e9-bf17-4c14-b43d-2ece4c9ecb1d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:56.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9f0bf8-be36-44ab-bd49-dd611eaca353 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:56.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9f0bf8-be36-44ab-bd49-dd611eaca353 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b6a87c3 2021-04-14T13:12:56.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9f0bf8-be36-44ab-bd49-dd611eaca353 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:56.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9f0bf8-be36-44ab-bd49-dd611eaca353 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:12:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94d861c0-f3c5-48ad-b680-12bb109fe4b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:12:59.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94d861c0-f3c5-48ad-b680-12bb109fe4b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ed98cd6 2021-04-14T13:12:59.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94d861c0-f3c5-48ad-b680-12bb109fe4b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:12:59.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94d861c0-f3c5-48ad-b680-12bb109fe4b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:02.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551df838-1f61-4f8e-aae3-1d952456d7dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:02.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551df838-1f61-4f8e-aae3-1d952456d7dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2255e1 2021-04-14T13:13:02.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551df838-1f61-4f8e-aae3-1d952456d7dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:02.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=551df838-1f61-4f8e-aae3-1d952456d7dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:13:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:13:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:13:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:13:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:13:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:13:06.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=433093d1-bf7d-4ac2-a31f-1ba4b65ad374 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:06.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=433093d1-bf7d-4ac2-a31f-1ba4b65ad374 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@282cb7f 2021-04-14T13:13:06.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=433093d1-bf7d-4ac2-a31f-1ba4b65ad374 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:06.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=433093d1-bf7d-4ac2-a31f-1ba4b65ad374 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:06.241Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b1a0aa5a-6c7a-4acb-b71f-ca2bdf7040d9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:13:06.241507Z InvocationID=718fb8d7-af27-4ea5-926a-9ff71a63688c LogTimestamp=2021-04-14T13:13:06.241562Z Entering 2021-04-14T13:13:06.242Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b1a0aa5a-6c7a-4acb-b71f-ca2bdf7040d9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:13:06.241507Z InvocationID=718fb8d7-af27-4ea5-926a-9ff71a63688c LogTimestamp=2021-04-14T13:13:06.241562Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:13:06.243Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:13:06.242Z InvocationID=3b52dd4d-8656-42d2-be74-59b6c0353fd5 LogTimestamp=2021-04-14T13:13:06.243180Z ResponseDesc=OK Exiting. 2021-04-14T13:13:06.243Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:13:08.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dfa5cc3-4c34-4f46-b17f-30921c526624 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:08.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dfa5cc3-4c34-4f46-b17f-30921c526624 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@dd91073 2021-04-14T13:13:08.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dfa5cc3-4c34-4f46-b17f-30921c526624 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:08.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6dfa5cc3-4c34-4f46-b17f-30921c526624 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94a31b1e-7791-4d2e-880d-8368a4faabfb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94a31b1e-7791-4d2e-880d-8368a4faabfb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f248222 2021-04-14T13:13:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94a31b1e-7791-4d2e-880d-8368a4faabfb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94a31b1e-7791-4d2e-880d-8368a4faabfb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccba60e2-6d68-477d-9ee3-794fd932acae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccba60e2-6d68-477d-9ee3-794fd932acae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dbb4b7a 2021-04-14T13:13:14.689Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccba60e2-6d68-477d-9ee3-794fd932acae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ccba60e2-6d68-477d-9ee3-794fd932acae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=107a7284-1d62-4f9b-a6f2-6e3eb843cad4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=107a7284-1d62-4f9b-a6f2-6e3eb843cad4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49f6ba81 2021-04-14T13:13:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=107a7284-1d62-4f9b-a6f2-6e3eb843cad4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=107a7284-1d62-4f9b-a6f2-6e3eb843cad4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e177189a-77ec-4c70-b2fd-74309f9ffe71 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e177189a-77ec-4c70-b2fd-74309f9ffe71 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ce96144 2021-04-14T13:13:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e177189a-77ec-4c70-b2fd-74309f9ffe71 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e177189a-77ec-4c70-b2fd-74309f9ffe71 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=078b74da-90d3-4acb-a2e9-5c59749a643d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=078b74da-90d3-4acb-a2e9-5c59749a643d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6737c769 2021-04-14T13:13:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=078b74da-90d3-4acb-a2e9-5c59749a643d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:24.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=078b74da-90d3-4acb-a2e9-5c59749a643d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:27.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831a91ec-ec94-4d38-bbef-e5e967d49660 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:27.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831a91ec-ec94-4d38-bbef-e5e967d49660 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60d0a06e 2021-04-14T13:13:27.103Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831a91ec-ec94-4d38-bbef-e5e967d49660 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:27.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=831a91ec-ec94-4d38-bbef-e5e967d49660 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:29.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2051236-c38f-4a3b-af12-0aa7c03ea1e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:29.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2051236-c38f-4a3b-af12-0aa7c03ea1e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1c0e2c47 2021-04-14T13:13:29.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2051236-c38f-4a3b-af12-0aa7c03ea1e8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:29.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2051236-c38f-4a3b-af12-0aa7c03ea1e8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:33.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca6295e-beb0-43f3-8ff6-4e45aba35078 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:33.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca6295e-beb0-43f3-8ff6-4e45aba35078 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5baa8dc3 2021-04-14T13:13:33.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca6295e-beb0-43f3-8ff6-4e45aba35078 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:33.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca6295e-beb0-43f3-8ff6-4e45aba35078 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:36.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477a05d0-3a88-4dd8-bbb9-839a3306ac72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:36.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477a05d0-3a88-4dd8-bbb9-839a3306ac72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ff0550 2021-04-14T13:13:36.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477a05d0-3a88-4dd8-bbb9-839a3306ac72 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:36.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=477a05d0-3a88-4dd8-bbb9-839a3306ac72 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:36.233Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=109894d5-303e-4f01-ab7c-bce259629a98 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:13:36.233009Z InvocationID=073e6cde-a52b-494a-890e-bcc319e362a9 LogTimestamp=2021-04-14T13:13:36.233079Z Entering 2021-04-14T13:13:36.233Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=109894d5-303e-4f01-ab7c-bce259629a98 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:13:36.233009Z InvocationID=073e6cde-a52b-494a-890e-bcc319e362a9 LogTimestamp=2021-04-14T13:13:36.233079Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:13:36.236Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:13:36.234Z InvocationID=e4117b4f-f816-49af-98a4-84d88fcce30e LogTimestamp=2021-04-14T13:13:36.236151Z ResponseDesc=OK Exiting. 2021-04-14T13:13:36.236Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:13:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d437d-7590-472f-8c72-7fdeff45cbf0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d437d-7590-472f-8c72-7fdeff45cbf0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@674906b1 2021-04-14T13:13:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d437d-7590-472f-8c72-7fdeff45cbf0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:38.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=598d437d-7590-472f-8c72-7fdeff45cbf0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a967ede8-05d1-49f1-9e7d-40b5d6ad342b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a967ede8-05d1-49f1-9e7d-40b5d6ad342b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a48720b 2021-04-14T13:13:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a967ede8-05d1-49f1-9e7d-40b5d6ad342b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:41.591Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a967ede8-05d1-49f1-9e7d-40b5d6ad342b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:45.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53be2fe0-1f04-41e3-a776-9261d3b54cd5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53be2fe0-1f04-41e3-a776-9261d3b54cd5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5832214 2021-04-14T13:13:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53be2fe0-1f04-41e3-a776-9261d3b54cd5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53be2fe0-1f04-41e3-a776-9261d3b54cd5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:13:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:13:47.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44849009-ce94-4208-9a73-bc960dca53ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44849009-ce94-4208-9a73-bc960dca53ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fac7271 2021-04-14T13:13:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44849009-ce94-4208-9a73-bc960dca53ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:47.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=44849009-ce94-4208-9a73-bc960dca53ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:48.215Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cbd8a9d4-47ea-432d-bc34-40b8c01e3636 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:13:48.214981Z InvocationID=a56cbb2b-bac3-4856-b91f-a26d0c1fa38f LogTimestamp=2021-04-14T13:13:48.215057Z Entering 2021-04-14T13:13:48.215Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cbd8a9d4-47ea-432d-bc34-40b8c01e3636 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:13:48.214981Z InvocationID=a56cbb2b-bac3-4856-b91f-a26d0c1fa38f LogTimestamp=2021-04-14T13:13:48.215057Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:13:48.218Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:13:48.215Z InvocationID=7b4d0033-6155-4944-8c73-7f8e9d91f33f LogTimestamp=2021-04-14T13:13:48.218027Z ResponseDesc=OK Exiting. 2021-04-14T13:13:48.218Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:13:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad5e3f9-2024-41c7-b9d5-974a8eb6903d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad5e3f9-2024-41c7-b9d5-974a8eb6903d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50ff9fbb 2021-04-14T13:13:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad5e3f9-2024-41c7-b9d5-974a8eb6903d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dad5e3f9-2024-41c7-b9d5-974a8eb6903d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:53.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9beae4-0b98-4891-92cd-e1e81c9633a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9beae4-0b98-4891-92cd-e1e81c9633a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@196e7785 2021-04-14T13:13:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9beae4-0b98-4891-92cd-e1e81c9633a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:53.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9beae4-0b98-4891-92cd-e1e81c9633a3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:57.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c7875ce-632a-4b7a-b934-d77a5a2e5dbd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:57.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c7875ce-632a-4b7a-b934-d77a5a2e5dbd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e1753e 2021-04-14T13:13:57.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c7875ce-632a-4b7a-b934-d77a5a2e5dbd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:57.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c7875ce-632a-4b7a-b934-d77a5a2e5dbd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:13:59.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b40089f-3cd1-422a-b433-0625fe34d523 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:13:59.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b40089f-3cd1-422a-b433-0625fe34d523 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1942a009 2021-04-14T13:13:59.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b40089f-3cd1-422a-b433-0625fe34d523 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:13:59.533Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b40089f-3cd1-422a-b433-0625fe34d523 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:01.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5115bee9-aa6c-470e-8d5f-809d91e494f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5115bee9-aa6c-470e-8d5f-809d91e494f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@356ce6dd 2021-04-14T13:14:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5115bee9-aa6c-470e-8d5f-809d91e494f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:02.913Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5115bee9-aa6c-470e-8d5f-809d91e494f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:04.353Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:14:04.353Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:14:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:14:04.354Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:14:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:14:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:14:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab7ad33c-7884-4535-82c9-1c05e7be4c6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab7ad33c-7884-4535-82c9-1c05e7be4c6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f546daa 2021-04-14T13:14:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab7ad33c-7884-4535-82c9-1c05e7be4c6c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab7ad33c-7884-4535-82c9-1c05e7be4c6c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:06.254Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bae4fb71-1790-47f2-a623-76d22a4dc236 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:14:06.254628Z InvocationID=5e775901-9d48-4158-a27c-69b7bc70b599 LogTimestamp=2021-04-14T13:14:06.254671Z Entering 2021-04-14T13:14:06.254Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bae4fb71-1790-47f2-a623-76d22a4dc236 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:14:06.254628Z InvocationID=5e775901-9d48-4158-a27c-69b7bc70b599 LogTimestamp=2021-04-14T13:14:06.254671Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:14:06.256Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:14:06.255Z InvocationID=9dcd73eb-98d5-4b3f-a2e0-37d42b47d392 LogTimestamp=2021-04-14T13:14:06.256178Z ResponseDesc=OK Exiting. 2021-04-14T13:14:06.256Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:14:09.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f66e6844-d41d-40c4-95ad-dc182790d4ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:09.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f66e6844-d41d-40c4-95ad-dc182790d4ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5192bbfb 2021-04-14T13:14:09.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f66e6844-d41d-40c4-95ad-dc182790d4ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:09.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f66e6844-d41d-40c4-95ad-dc182790d4ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c760115b-259a-4923-bf16-9253a1c75ef4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c760115b-259a-4923-bf16-9253a1c75ef4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ddc1b28 2021-04-14T13:14:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c760115b-259a-4923-bf16-9253a1c75ef4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c760115b-259a-4923-bf16-9253a1c75ef4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007f5672-830e-4b13-974e-1d0156cf1332 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007f5672-830e-4b13-974e-1d0156cf1332 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fd44440 2021-04-14T13:14:14.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007f5672-830e-4b13-974e-1d0156cf1332 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:14.805Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=007f5672-830e-4b13-974e-1d0156cf1332 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=485cc539-4d59-4624-bb74-feb0b5d1ce3b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=485cc539-4d59-4624-bb74-feb0b5d1ce3b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7391412d 2021-04-14T13:14:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=485cc539-4d59-4624-bb74-feb0b5d1ce3b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=485cc539-4d59-4624-bb74-feb0b5d1ce3b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=651c8d72-ffc4-4113-b9f7-c8821bb3eb45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=651c8d72-ffc4-4113-b9f7-c8821bb3eb45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@371861c7 2021-04-14T13:14:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=651c8d72-ffc4-4113-b9f7-c8821bb3eb45 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:20.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=651c8d72-ffc4-4113-b9f7-c8821bb3eb45 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e47d00-71ec-452f-a59e-4d584735db7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e47d00-71ec-452f-a59e-4d584735db7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@aa02957 2021-04-14T13:14:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e47d00-71ec-452f-a59e-4d584735db7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9e47d00-71ec-452f-a59e-4d584735db7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2058f158-fbbc-4388-afab-ed37eed67f5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2058f158-fbbc-4388-afab-ed37eed67f5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27fb9a07 2021-04-14T13:14:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2058f158-fbbc-4388-afab-ed37eed67f5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2058f158-fbbc-4388-afab-ed37eed67f5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:30.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f961b314-68f5-4c36-b176-fffbd54ca17c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:30.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f961b314-68f5-4c36-b176-fffbd54ca17c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e9a3ffc 2021-04-14T13:14:30.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f961b314-68f5-4c36-b176-fffbd54ca17c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:30.114Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f961b314-68f5-4c36-b176-fffbd54ca17c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46380264-782d-49a7-ad85-0ea6bd883e17 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46380264-782d-49a7-ad85-0ea6bd883e17 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2af87bb1 2021-04-14T13:14:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46380264-782d-49a7-ad85-0ea6bd883e17 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:33.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46380264-782d-49a7-ad85-0ea6bd883e17 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:35.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a48df6a-211e-458c-8bd4-c265b73b9f74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:35.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a48df6a-211e-458c-8bd4-c265b73b9f74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21190528 2021-04-14T13:14:35.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a48df6a-211e-458c-8bd4-c265b73b9f74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:35.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a48df6a-211e-458c-8bd4-c265b73b9f74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:36.221Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=48cefce5-cc4e-4313-a88b-e83330c7b2f2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:14:36.221263Z InvocationID=703a956f-a5f0-460b-8c53-9f641463a0b6 LogTimestamp=2021-04-14T13:14:36.221331Z Entering 2021-04-14T13:14:36.221Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=48cefce5-cc4e-4313-a88b-e83330c7b2f2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:14:36.221263Z InvocationID=703a956f-a5f0-460b-8c53-9f641463a0b6 LogTimestamp=2021-04-14T13:14:36.221331Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:14:36.223Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:14:36.222Z InvocationID=d2e2b170-ea8c-4e68-89ae-de22ca38e6bc LogTimestamp=2021-04-14T13:14:36.223324Z ResponseDesc=OK Exiting. 2021-04-14T13:14:36.223Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:14:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a719762-f021-4617-ae23-b606bff78075 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a719762-f021-4617-ae23-b606bff78075 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5a4988ae 2021-04-14T13:14:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a719762-f021-4617-ae23-b606bff78075 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:38.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a719762-f021-4617-ae23-b606bff78075 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b547bfb4-0718-4e5d-ab84-1d6db7495ff5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b547bfb4-0718-4e5d-ab84-1d6db7495ff5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55a339c4 2021-04-14T13:14:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b547bfb4-0718-4e5d-ab84-1d6db7495ff5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b547bfb4-0718-4e5d-ab84-1d6db7495ff5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f726de8d-1b14-48d6-ad1e-7a5bda002c46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f726de8d-1b14-48d6-ad1e-7a5bda002c46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c6ff532 2021-04-14T13:14:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f726de8d-1b14-48d6-ad1e-7a5bda002c46 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:45.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f726de8d-1b14-48d6-ad1e-7a5bda002c46 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:46.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:14:46.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:14:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e47d07a-e24f-4f06-b292-29da05d0607b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e47d07a-e24f-4f06-b292-29da05d0607b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55b687d2 2021-04-14T13:14:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e47d07a-e24f-4f06-b292-29da05d0607b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e47d07a-e24f-4f06-b292-29da05d0607b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b20ea87-1817-4479-8976-3038d556ed96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:51.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b20ea87-1817-4479-8976-3038d556ed96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43ac6932 2021-04-14T13:14:51.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b20ea87-1817-4479-8976-3038d556ed96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:51.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b20ea87-1817-4479-8976-3038d556ed96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d658de74-8320-4599-8d6e-7ec869efc852 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d658de74-8320-4599-8d6e-7ec869efc852 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f0d059a 2021-04-14T13:14:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d658de74-8320-4599-8d6e-7ec869efc852 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:53.841Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d658de74-8320-4599-8d6e-7ec869efc852 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:57.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d792fc46-23ff-46a7-a3dc-65c558e53abf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:57.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d792fc46-23ff-46a7-a3dc-65c558e53abf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c88a72c 2021-04-14T13:14:57.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d792fc46-23ff-46a7-a3dc-65c558e53abf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:57.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d792fc46-23ff-46a7-a3dc-65c558e53abf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:14:59.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb1c18aa-7125-4373-bcfc-361e01ad350f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:14:59.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb1c18aa-7125-4373-bcfc-361e01ad350f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d613178 2021-04-14T13:14:59.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb1c18aa-7125-4373-bcfc-361e01ad350f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:14:59.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb1c18aa-7125-4373-bcfc-361e01ad350f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb29794-93cc-410b-9c2c-c69c69a0cce0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb29794-93cc-410b-9c2c-c69c69a0cce0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d24281f 2021-04-14T13:15:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb29794-93cc-410b-9c2c-c69c69a0cce0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:02.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3fb29794-93cc-410b-9c2c-c69c69a0cce0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:04.358Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:15:04.358Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:15:04.359Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:15:04.359Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:15:04.362Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:04.362Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:15:04.363Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:15:06.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e67d3-1452-442f-a0ff-c8eee9285fc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:06.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e67d3-1452-442f-a0ff-c8eee9285fc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a62cdf4 2021-04-14T13:15:06.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e67d3-1452-442f-a0ff-c8eee9285fc5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:06.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c91e67d3-1452-442f-a0ff-c8eee9285fc5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:06.247Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2154a77d-ebce-4aca-8a46-820930dd6fb9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:15:06.246768Z InvocationID=de093dc6-44fd-4837-977d-5f6135f8d6e2 LogTimestamp=2021-04-14T13:15:06.246823Z Entering 2021-04-14T13:15:06.247Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2154a77d-ebce-4aca-8a46-820930dd6fb9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:15:06.246768Z InvocationID=de093dc6-44fd-4837-977d-5f6135f8d6e2 LogTimestamp=2021-04-14T13:15:06.246823Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:15:06.250Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:15:06.247Z InvocationID=2c54efb4-55b3-44df-9942-b035b642a684 LogTimestamp=2021-04-14T13:15:06.250441Z ResponseDesc=OK Exiting. 2021-04-14T13:15:06.250Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3358dac-de64-4f9a-8e9f-6415834dcb5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3358dac-de64-4f9a-8e9f-6415834dcb5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63daa653 2021-04-14T13:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3358dac-de64-4f9a-8e9f-6415834dcb5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f3358dac-de64-4f9a-8e9f-6415834dcb5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2413bd0-4188-4f74-a63c-792dc32b288b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2413bd0-4188-4f74-a63c-792dc32b288b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4714a1a1 2021-04-14T13:15:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2413bd0-4188-4f74-a63c-792dc32b288b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2413bd0-4188-4f74-a63c-792dc32b288b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457f8a73-94d6-4190-81a0-c9b96444348e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457f8a73-94d6-4190-81a0-c9b96444348e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bdc0d8c 2021-04-14T13:15:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457f8a73-94d6-4190-81a0-c9b96444348e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:14.690Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=457f8a73-94d6-4190-81a0-c9b96444348e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c75ca09-990d-4fe8-acb8-be79ee98176b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c75ca09-990d-4fe8-acb8-be79ee98176b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@172d606e 2021-04-14T13:15:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c75ca09-990d-4fe8-acb8-be79ee98176b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c75ca09-990d-4fe8-acb8-be79ee98176b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7025f3a-381a-4d88-b8cc-149350ec5229 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7025f3a-381a-4d88-b8cc-149350ec5229 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21f3a4e6 2021-04-14T13:15:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7025f3a-381a-4d88-b8cc-149350ec5229 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7025f3a-381a-4d88-b8cc-149350ec5229 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee47de94-dfa7-48ac-aaf0-aecb0ff8a1d7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee47de94-dfa7-48ac-aaf0-aecb0ff8a1d7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@438800d0 2021-04-14T13:15:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee47de94-dfa7-48ac-aaf0-aecb0ff8a1d7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:24.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee47de94-dfa7-48ac-aaf0-aecb0ff8a1d7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:27.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f32ceb-d37f-407d-a963-bcd7048077bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:27.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f32ceb-d37f-407d-a963-bcd7048077bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48b3c540 2021-04-14T13:15:27.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f32ceb-d37f-407d-a963-bcd7048077bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:27.199Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57f32ceb-d37f-407d-a963-bcd7048077bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=509ddc99-0776-4a33-9caf-3127579e53e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=509ddc99-0776-4a33-9caf-3127579e53e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3461f228 2021-04-14T13:15:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=509ddc99-0776-4a33-9caf-3127579e53e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:30.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=509ddc99-0776-4a33-9caf-3127579e53e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b527ac21-f13d-4cf8-a71a-6e1d2633359e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b527ac21-f13d-4cf8-a71a-6e1d2633359e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@889a4d6 2021-04-14T13:15:33.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b527ac21-f13d-4cf8-a71a-6e1d2633359e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b527ac21-f13d-4cf8-a71a-6e1d2633359e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:35.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a137c366-4ea0-48ab-8eae-3fde25459dd7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:35.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a137c366-4ea0-48ab-8eae-3fde25459dd7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b84bb97 2021-04-14T13:15:35.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a137c366-4ea0-48ab-8eae-3fde25459dd7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:35.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a137c366-4ea0-48ab-8eae-3fde25459dd7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:36.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=61c04502-6a30-415e-ba66-315b1b46c055 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:15:36.235234Z InvocationID=cdf688f5-c837-4a24-817c-78492b343f4e LogTimestamp=2021-04-14T13:15:36.235314Z Entering 2021-04-14T13:15:36.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=61c04502-6a30-415e-ba66-315b1b46c055 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:15:36.235234Z InvocationID=cdf688f5-c837-4a24-817c-78492b343f4e LogTimestamp=2021-04-14T13:15:36.235314Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:15:36.237Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:15:36.235Z InvocationID=5245aa3c-93b5-4025-8f0d-36629901c3f3 LogTimestamp=2021-04-14T13:15:36.237474Z ResponseDesc=OK Exiting. 2021-04-14T13:15:36.237Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:15:39.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc97e823-7430-4198-ac3e-45b5f4f9edca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:39.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc97e823-7430-4198-ac3e-45b5f4f9edca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dcbe662 2021-04-14T13:15:39.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc97e823-7430-4198-ac3e-45b5f4f9edca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:39.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bc97e823-7430-4198-ac3e-45b5f4f9edca PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c015842c-67a3-4d92-8566-80234793ad6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c015842c-67a3-4d92-8566-80234793ad6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6680bf41 2021-04-14T13:15:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c015842c-67a3-4d92-8566-80234793ad6e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:41.558Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c015842c-67a3-4d92-8566-80234793ad6e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b859ba8-30e9-4515-b584-df60104634ee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b859ba8-30e9-4515-b584-df60104634ee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23ea0853 2021-04-14T13:15:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b859ba8-30e9-4515-b584-df60104634ee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:45.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b859ba8-30e9-4515-b584-df60104634ee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:15:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:15:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82bdb431-791e-40f8-95f3-5ce530e2144e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82bdb431-791e-40f8-95f3-5ce530e2144e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d9c47ba 2021-04-14T13:15:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82bdb431-791e-40f8-95f3-5ce530e2144e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=82bdb431-791e-40f8-95f3-5ce530e2144e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:48.227Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ddc4a907-5584-4d25-97e8-988bc807b093 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:15:48.227522Z InvocationID=29f9dbb9-04da-49f6-a147-c7625f9e3ad7 LogTimestamp=2021-04-14T13:15:48.227547Z Entering 2021-04-14T13:15:48.227Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ddc4a907-5584-4d25-97e8-988bc807b093 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:15:48.227522Z InvocationID=29f9dbb9-04da-49f6-a147-c7625f9e3ad7 LogTimestamp=2021-04-14T13:15:48.227547Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:15:48.229Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:15:48.227Z InvocationID=5f0ebc3f-f792-43d1-b131-d27eed2217a4 LogTimestamp=2021-04-14T13:15:48.229012Z ResponseDesc=OK Exiting. 2021-04-14T13:15:48.229Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:15:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fa0b783-ab34-46f5-976d-c7fedf36dbbc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fa0b783-ab34-46f5-976d-c7fedf36dbbc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fe6589d 2021-04-14T13:15:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fa0b783-ab34-46f5-976d-c7fedf36dbbc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2fa0b783-ab34-46f5-976d-c7fedf36dbbc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0582b185-f39a-4b4b-8ae8-3d0a97f45093 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0582b185-f39a-4b4b-8ae8-3d0a97f45093 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cff9497 2021-04-14T13:15:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0582b185-f39a-4b4b-8ae8-3d0a97f45093 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:53.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0582b185-f39a-4b4b-8ae8-3d0a97f45093 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7541b787-f903-4a11-b21e-208b364fff6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7541b787-f903-4a11-b21e-208b364fff6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fa4a1cb 2021-04-14T13:15:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7541b787-f903-4a11-b21e-208b364fff6b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7541b787-f903-4a11-b21e-208b364fff6b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:15:59.754Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e8a051-2432-4d35-a863-72a4d14f64ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:15:59.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e8a051-2432-4d35-a863-72a4d14f64ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@706a8412 2021-04-14T13:15:59.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e8a051-2432-4d35-a863-72a4d14f64ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:15:59.755Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e6e8a051-2432-4d35-a863-72a4d14f64ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:03.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f007f103-4442-4ee6-b2e9-c35d966e02fd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:03.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f007f103-4442-4ee6-b2e9-c35d966e02fd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d750832 2021-04-14T13:16:03.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f007f103-4442-4ee6-b2e9-c35d966e02fd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:03.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f007f103-4442-4ee6-b2e9-c35d966e02fd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:16:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:16:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:16:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:16:04.362Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:04.363Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:16:04.364Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:16:06.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb39187-09ff-4ba8-8619-597b8b1faab0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:06.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb39187-09ff-4ba8-8619-597b8b1faab0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dbe6627 2021-04-14T13:16:06.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb39187-09ff-4ba8-8619-597b8b1faab0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:06.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bb39187-09ff-4ba8-8619-597b8b1faab0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:06.237Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=47cffb02-cc24-43d5-8ae1-d060dc849c43 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:16:06.237039Z InvocationID=bd310e6e-966e-45d8-8c68-35dd8d8a354b LogTimestamp=2021-04-14T13:16:06.237108Z Entering 2021-04-14T13:16:06.237Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=47cffb02-cc24-43d5-8ae1-d060dc849c43 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:16:06.237039Z InvocationID=bd310e6e-966e-45d8-8c68-35dd8d8a354b LogTimestamp=2021-04-14T13:16:06.237108Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:16:06.240Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:16:06.237Z InvocationID=6dc4e986-9ef0-4adc-abc9-094c888cf2f0 LogTimestamp=2021-04-14T13:16:06.240011Z ResponseDesc=OK Exiting. 2021-04-14T13:16:06.240Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:16:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f903c828-6937-4c5c-b1e9-4b109740ef92 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f903c828-6937-4c5c-b1e9-4b109740ef92 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@67ae3ea2 2021-04-14T13:16:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f903c828-6937-4c5c-b1e9-4b109740ef92 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f903c828-6937-4c5c-b1e9-4b109740ef92 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6825190a-a42c-4ecc-8c89-ceec3acbffc8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6825190a-a42c-4ecc-8c89-ceec3acbffc8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43407c51 2021-04-14T13:16:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6825190a-a42c-4ecc-8c89-ceec3acbffc8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:12.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6825190a-a42c-4ecc-8c89-ceec3acbffc8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2f879e-547d-4273-acdd-e2bab0adbcad PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2f879e-547d-4273-acdd-e2bab0adbcad PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2611d893 2021-04-14T13:16:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2f879e-547d-4273-acdd-e2bab0adbcad PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:14.684Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e2f879e-547d-4273-acdd-e2bab0adbcad PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:18.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045decb7-97f1-4117-ae70-afe61f647d91 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:18.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045decb7-97f1-4117-ae70-afe61f647d91 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8300d28 2021-04-14T13:16:18.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045decb7-97f1-4117-ae70-afe61f647d91 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:18.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=045decb7-97f1-4117-ae70-afe61f647d91 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:20.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ffbd51-14e2-462a-adbc-74db560f6c44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:20.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ffbd51-14e2-462a-adbc-74db560f6c44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1efd69a2 2021-04-14T13:16:20.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ffbd51-14e2-462a-adbc-74db560f6c44 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:20.563Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33ffbd51-14e2-462a-adbc-74db560f6c44 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=926fda65-f8f4-4de5-b63d-48231c88527a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=926fda65-f8f4-4de5-b63d-48231c88527a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e1f3cd8 2021-04-14T13:16:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=926fda65-f8f4-4de5-b63d-48231c88527a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:24.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=926fda65-f8f4-4de5-b63d-48231c88527a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:27.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b62ee9-af12-44b2-8c4d-45ad77994bd8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:27.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b62ee9-af12-44b2-8c4d-45ad77994bd8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7662a2c8 2021-04-14T13:16:27.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b62ee9-af12-44b2-8c4d-45ad77994bd8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:27.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1b62ee9-af12-44b2-8c4d-45ad77994bd8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1c35d1-5933-4274-8bae-6fd61743d5d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1c35d1-5933-4274-8bae-6fd61743d5d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e33a861 2021-04-14T13:16:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1c35d1-5933-4274-8bae-6fd61743d5d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:30.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ae1c35d1-5933-4274-8bae-6fd61743d5d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:33.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fd5018-87ab-4944-8906-f3d01e167acc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:33.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fd5018-87ab-4944-8906-f3d01e167acc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@b767e7c 2021-04-14T13:16:33.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fd5018-87ab-4944-8906-f3d01e167acc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:33.233Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=55fd5018-87ab-4944-8906-f3d01e167acc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:35.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25dc96d-77c2-4daf-9037-05b956fb109a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:35.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25dc96d-77c2-4daf-9037-05b956fb109a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c287a36 2021-04-14T13:16:35.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25dc96d-77c2-4daf-9037-05b956fb109a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:35.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d25dc96d-77c2-4daf-9037-05b956fb109a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:36.248Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=74ea6ec4-a341-4ceb-a274-5edc25af2437 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:16:36.248139Z InvocationID=1942fd4b-4b59-48da-92f2-d9230c4f7460 LogTimestamp=2021-04-14T13:16:36.248190Z Entering 2021-04-14T13:16:36.248Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=74ea6ec4-a341-4ceb-a274-5edc25af2437 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:16:36.248139Z InvocationID=1942fd4b-4b59-48da-92f2-d9230c4f7460 LogTimestamp=2021-04-14T13:16:36.248190Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:16:36.250Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:16:36.248Z InvocationID=30d41639-a673-4ac4-a764-f9f15bb4006e LogTimestamp=2021-04-14T13:16:36.250165Z ResponseDesc=OK Exiting. 2021-04-14T13:16:36.250Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:16:38.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2343fc88-1e15-4e25-978a-5f151cb702b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:38.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2343fc88-1e15-4e25-978a-5f151cb702b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4fbff999 2021-04-14T13:16:38.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2343fc88-1e15-4e25-978a-5f151cb702b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:38.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2343fc88-1e15-4e25-978a-5f151cb702b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b2c8531-0bd3-4d16-a76a-36952605806d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b2c8531-0bd3-4d16-a76a-36952605806d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cac20af 2021-04-14T13:16:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b2c8531-0bd3-4d16-a76a-36952605806d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b2c8531-0bd3-4d16-a76a-36952605806d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=503c6e49-f1f0-42b1-bb0e-99e589390232 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=503c6e49-f1f0-42b1-bb0e-99e589390232 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14913ed8 2021-04-14T13:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=503c6e49-f1f0-42b1-bb0e-99e589390232 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:45.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=503c6e49-f1f0-42b1-bb0e-99e589390232 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:16:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:16:47.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee6b6afe-68b0-4fbd-bb29-d4f212db8d77 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:47.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee6b6afe-68b0-4fbd-bb29-d4f212db8d77 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b871fb6 2021-04-14T13:16:47.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee6b6afe-68b0-4fbd-bb29-d4f212db8d77 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:47.789Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee6b6afe-68b0-4fbd-bb29-d4f212db8d77 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:51.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216f1b2c-9e32-4851-9399-dd5846edbc5a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:51.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216f1b2c-9e32-4851-9399-dd5846edbc5a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4b44526e 2021-04-14T13:16:51.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216f1b2c-9e32-4851-9399-dd5846edbc5a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:51.216Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=216f1b2c-9e32-4851-9399-dd5846edbc5a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:54.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a969a048-e681-42ee-81e7-4167e0b00f75 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:54.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a969a048-e681-42ee-81e7-4167e0b00f75 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a0baf1 2021-04-14T13:16:54.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a969a048-e681-42ee-81e7-4167e0b00f75 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:54.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a969a048-e681-42ee-81e7-4167e0b00f75 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:56.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb6ebafa-cd77-4b63-93c4-5437ebf79f45 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:56.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb6ebafa-cd77-4b63-93c4-5437ebf79f45 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bda3303 2021-04-14T13:16:56.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb6ebafa-cd77-4b63-93c4-5437ebf79f45 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:56.911Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb6ebafa-cd77-4b63-93c4-5437ebf79f45 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:16:59.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc191448-1c64-49df-84fd-7c855da1240a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:16:59.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc191448-1c64-49df-84fd-7c855da1240a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58e3f561 2021-04-14T13:16:59.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc191448-1c64-49df-84fd-7c855da1240a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:16:59.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc191448-1c64-49df-84fd-7c855da1240a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:03.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a8381a-4ea2-472b-956f-0318f87b94cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a8381a-4ea2-472b-956f-0318f87b94cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31dd1b31 2021-04-14T13:17:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a8381a-4ea2-472b-956f-0318f87b94cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:03.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9a8381a-4ea2-472b-956f-0318f87b94cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:17:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:17:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:17:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:17:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:17:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:17:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e41953-d2b5-4ef8-a74e-c4b976490083 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e41953-d2b5-4ef8-a74e-c4b976490083 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@322958c9 2021-04-14T13:17:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e41953-d2b5-4ef8-a74e-c4b976490083 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:06.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08e41953-d2b5-4ef8-a74e-c4b976490083 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:06.221Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5d8e8cdd-a7d4-4aa5-89ff-d6e72ef48ae3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:06.221674Z InvocationID=a7e51726-f65a-412b-8e5e-3ad53a1b03ce LogTimestamp=2021-04-14T13:17:06.221707Z Entering 2021-04-14T13:17:06.221Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5d8e8cdd-a7d4-4aa5-89ff-d6e72ef48ae3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:06.221674Z InvocationID=a7e51726-f65a-412b-8e5e-3ad53a1b03ce LogTimestamp=2021-04-14T13:17:06.221707Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:06.222Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:06.222Z InvocationID=17ebd106-5c09-4065-a143-afd1d1c590e9 LogTimestamp=2021-04-14T13:17:06.222853Z ResponseDesc=OK Exiting. 2021-04-14T13:17:06.223Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:08.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d763f5f-36a4-43fe-b234-7f5ae1d90547 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:08.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d763f5f-36a4-43fe-b234-7f5ae1d90547 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@782127a4 2021-04-14T13:17:08.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d763f5f-36a4-43fe-b234-7f5ae1d90547 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:08.812Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d763f5f-36a4-43fe-b234-7f5ae1d90547 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:12.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ffa3103-b63f-4d63-90ca-6ae6a71eb2b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:12.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ffa3103-b63f-4d63-90ca-6ae6a71eb2b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fae8d3c 2021-04-14T13:17:12.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ffa3103-b63f-4d63-90ca-6ae6a71eb2b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:12.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5ffa3103-b63f-4d63-90ca-6ae6a71eb2b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc43c44-1d47-4312-8fbc-52ae4946a1c8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:14.686Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc43c44-1d47-4312-8fbc-52ae4946a1c8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66731d6b 2021-04-14T13:17:14.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc43c44-1d47-4312-8fbc-52ae4946a1c8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:14.687Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddc43c44-1d47-4312-8fbc-52ae4946a1c8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=306377ee-9db7-4b77-bd1c-452a06a22555 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=306377ee-9db7-4b77-bd1c-452a06a22555 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e64fe7c 2021-04-14T13:17:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=306377ee-9db7-4b77-bd1c-452a06a22555 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:17.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=306377ee-9db7-4b77-bd1c-452a06a22555 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acfdde0-c883-4071-915f-180d9869705b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acfdde0-c883-4071-915f-180d9869705b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f89e613 2021-04-14T13:17:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acfdde0-c883-4071-915f-180d9869705b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5acfdde0-c883-4071-915f-180d9869705b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a34c784-5ecb-44fe-a8ff-4996b5db9d3d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a34c784-5ecb-44fe-a8ff-4996b5db9d3d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@240551b3 2021-04-14T13:17:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a34c784-5ecb-44fe-a8ff-4996b5db9d3d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5a34c784-5ecb-44fe-a8ff-4996b5db9d3d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe3808c6-2523-40cb-8fb9-17b6b9150b3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe3808c6-2523-40cb-8fb9-17b6b9150b3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ae3981d 2021-04-14T13:17:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe3808c6-2523-40cb-8fb9-17b6b9150b3a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:27.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe3808c6-2523-40cb-8fb9-17b6b9150b3a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afff017d-5b19-432a-a14c-14c8afcc1a3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afff017d-5b19-432a-a14c-14c8afcc1a3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@634d0a23 2021-04-14T13:17:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afff017d-5b19-432a-a14c-14c8afcc1a3c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=afff017d-5b19-432a-a14c-14c8afcc1a3c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f308a4d9-506c-4d80-a952-e35996fdab68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f308a4d9-506c-4d80-a952-e35996fdab68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4354d127 2021-04-14T13:17:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f308a4d9-506c-4d80-a952-e35996fdab68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:33.226Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f308a4d9-506c-4d80-a952-e35996fdab68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979e90b7-6c6b-4593-9241-6159cd3d9479 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979e90b7-6c6b-4593-9241-6159cd3d9479 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d529837 2021-04-14T13:17:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979e90b7-6c6b-4593-9241-6159cd3d9479 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:35.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=979e90b7-6c6b-4593-9241-6159cd3d9479 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:36.248Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=141ed740-fa5f-4189-94c9-8812b18896f5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:36.248420Z InvocationID=0e27268b-889c-46c4-96ff-69cdfa38ec39 LogTimestamp=2021-04-14T13:17:36.248504Z Entering 2021-04-14T13:17:36.248Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=141ed740-fa5f-4189-94c9-8812b18896f5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:36.248420Z InvocationID=0e27268b-889c-46c4-96ff-69cdfa38ec39 LogTimestamp=2021-04-14T13:17:36.248504Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:36.250Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:36.249Z InvocationID=dcc490df-8704-4d5f-9de5-9fcba7f1eb0a LogTimestamp=2021-04-14T13:17:36.250403Z ResponseDesc=OK Exiting. 2021-04-14T13:17:36.250Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add9e76f-4427-40ba-b2f2-5d0e0de1e4fe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add9e76f-4427-40ba-b2f2-5d0e0de1e4fe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bb7d2f0 2021-04-14T13:17:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add9e76f-4427-40ba-b2f2-5d0e0de1e4fe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:39.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=add9e76f-4427-40ba-b2f2-5d0e0de1e4fe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5f9851d-2d22-4475-ac1e-8c97ad8c8320 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5f9851d-2d22-4475-ac1e-8c97ad8c8320 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20ddb7 2021-04-14T13:17:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5f9851d-2d22-4475-ac1e-8c97ad8c8320 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:41.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c5f9851d-2d22-4475-ac1e-8c97ad8c8320 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:44.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a385d4a1-2f56-4db5-9c39-499aaf3255bf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:44.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a385d4a1-2f56-4db5-9c39-499aaf3255bf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6518f97d 2021-04-14T13:17:44.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a385d4a1-2f56-4db5-9c39-499aaf3255bf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:44.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a385d4a1-2f56-4db5-9c39-499aaf3255bf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:46.198Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:46.202Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:46.203Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:17:46.203Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:17:47.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee17dc5-4277-4856-8689-3570688794ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:47.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee17dc5-4277-4856-8689-3570688794ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cd246c9 2021-04-14T13:17:47.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee17dc5-4277-4856-8689-3570688794ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:47.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eee17dc5-4277-4856-8689-3570688794ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:48.232Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ee1bd46e-0d41-4495-9be2-53619fe0508b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:48.232251Z InvocationID=5ddb5814-0142-4314-944f-c77c9996f976 LogTimestamp=2021-04-14T13:17:48.232301Z Entering 2021-04-14T13:17:48.232Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ee1bd46e-0d41-4495-9be2-53619fe0508b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:48.232251Z InvocationID=5ddb5814-0142-4314-944f-c77c9996f976 LogTimestamp=2021-04-14T13:17:48.232301Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:48.233Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:48.232Z InvocationID=4c7511ff-a418-45e2-ae84-6b7acdbbec76 LogTimestamp=2021-04-14T13:17:48.233538Z ResponseDesc=OK Exiting. 2021-04-14T13:17:48.233Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:51.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41122323-04a7-4bdf-88c4-822e6ebfa9c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:51.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41122323-04a7-4bdf-88c4-822e6ebfa9c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@94733f1 2021-04-14T13:17:51.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41122323-04a7-4bdf-88c4-822e6ebfa9c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:51.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41122323-04a7-4bdf-88c4-822e6ebfa9c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:51.621Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e86fa82f-c514-46c5-bb03-7ddee0a4d536 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:51.620968Z InvocationID=e7022474-215d-410f-8fe9-7ac56b6b0ea3 LogTimestamp=2021-04-14T13:17:51.621037Z Entering 2021-04-14T13:17:51.621Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e86fa82f-c514-46c5-bb03-7ddee0a4d536 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:51.620968Z InvocationID=e7022474-215d-410f-8fe9-7ac56b6b0ea3 LogTimestamp=2021-04-14T13:17:51.621037Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:51.622Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:51.621Z InvocationID=dc26094b-54ba-4cea-9056-6acba416e613 LogTimestamp=2021-04-14T13:17:51.622631Z ResponseDesc=OK Exiting. 2021-04-14T13:17:51.622Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:51.669Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a6b0a1f6-35d4-47a5-882b-92f028dc83a9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:51.669723Z InvocationID=6a0770c8-7e18-45b6-915a-68f16452b205 LogTimestamp=2021-04-14T13:17:51.669747Z Entering 2021-04-14T13:17:51.669Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a6b0a1f6-35d4-47a5-882b-92f028dc83a9 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:51.669723Z InvocationID=6a0770c8-7e18-45b6-915a-68f16452b205 LogTimestamp=2021-04-14T13:17:51.669747Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:51.670Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:51.670Z InvocationID=c3eef12a-2d69-441e-b9de-c7110ff40e9a LogTimestamp=2021-04-14T13:17:51.670578Z ResponseDesc=OK Exiting. 2021-04-14T13:17:51.670Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:54.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd82cbe2-caaa-4c29-b12a-0f5f2af905a5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:54.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd82cbe2-caaa-4c29-b12a-0f5f2af905a5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f0c8a0b 2021-04-14T13:17:54.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd82cbe2-caaa-4c29-b12a-0f5f2af905a5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:54.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dd82cbe2-caaa-4c29-b12a-0f5f2af905a5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:55.001Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fac65dc7-46e5-41fc-8db2-12e1c95c7f0d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:55.001675Z InvocationID=6cb0e873-af2f-4338-9cd9-6dca0b4bfab4 LogTimestamp=2021-04-14T13:17:55.001702Z Entering 2021-04-14T13:17:55.001Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fac65dc7-46e5-41fc-8db2-12e1c95c7f0d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:55.001675Z InvocationID=6cb0e873-af2f-4338-9cd9-6dca0b4bfab4 LogTimestamp=2021-04-14T13:17:55.001702Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:55.002Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:55.002Z InvocationID=bd9e1c21-026e-4bc5-b825-6c5d221c00b3 LogTimestamp=2021-04-14T13:17:55.002849Z ResponseDesc=OK Exiting. 2021-04-14T13:17:55.003Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:55.052Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fb4b5591-9fbe-4bb6-a9d9-9be2d18dd2ea InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:55.052762Z InvocationID=5ad7be52-8589-4eea-bd95-e00a16da8835 LogTimestamp=2021-04-14T13:17:55.052785Z Entering 2021-04-14T13:17:55.052Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fb4b5591-9fbe-4bb6-a9d9-9be2d18dd2ea InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:55.052762Z InvocationID=5ad7be52-8589-4eea-bd95-e00a16da8835 LogTimestamp=2021-04-14T13:17:55.052785Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:55.053Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:55.053Z InvocationID=1a8e1a69-b8af-4784-8d90-c1662b3b9301 LogTimestamp=2021-04-14T13:17:55.053631Z ResponseDesc=OK Exiting. 2021-04-14T13:17:55.053Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:17:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9aaeac5-6121-4800-ad08-4be5d2a4fbb2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9aaeac5-6121-4800-ad08-4be5d2a4fbb2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d7d4986 2021-04-14T13:17:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9aaeac5-6121-4800-ad08-4be5d2a4fbb2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9aaeac5-6121-4800-ad08-4be5d2a4fbb2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:59.886Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535b7d65-b844-4b18-bd23-8fc26a69cc93 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:17:59.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535b7d65-b844-4b18-bd23-8fc26a69cc93 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@337b6ee 2021-04-14T13:17:59.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535b7d65-b844-4b18-bd23-8fc26a69cc93 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:17:59.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=535b7d65-b844-4b18-bd23-8fc26a69cc93 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:17:59.967Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=91df874e-f1e7-45f8-b9bb-1de7c21a7ed2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:59.967591Z InvocationID=8f87e58c-1a6a-4e62-9a21-0c2449466b83 LogTimestamp=2021-04-14T13:17:59.967636Z Entering 2021-04-14T13:17:59.967Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=91df874e-f1e7-45f8-b9bb-1de7c21a7ed2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:17:59.967591Z InvocationID=8f87e58c-1a6a-4e62-9a21-0c2449466b83 LogTimestamp=2021-04-14T13:17:59.967636Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:17:59.968Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:17:59.968Z InvocationID=9eb83fa8-5d66-4e16-85a2-165a045639e0 LogTimestamp=2021-04-14T13:17:59.968882Z ResponseDesc=OK Exiting. 2021-04-14T13:17:59.969Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:18:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7f1af7-8246-4f9a-84d8-b3daeef9180a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7f1af7-8246-4f9a-84d8-b3daeef9180a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@335fd5c2 2021-04-14T13:18:02.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7f1af7-8246-4f9a-84d8-b3daeef9180a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:02.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2a7f1af7-8246-4f9a-84d8-b3daeef9180a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:18:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:18:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:18:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:18:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:18:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05343cd-21fd-4cb1-9e67-41b3733abb63 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05343cd-21fd-4cb1-9e67-41b3733abb63 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58684d70 2021-04-14T13:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05343cd-21fd-4cb1-9e67-41b3733abb63 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:06.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c05343cd-21fd-4cb1-9e67-41b3733abb63 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:06.240Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=458270d4-5635-4dfa-b2bf-c8364e9713a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:06.240292Z InvocationID=552f8d34-da56-4a82-8a6b-7bad6779d1d8 LogTimestamp=2021-04-14T13:18:06.240331Z Entering 2021-04-14T13:18:06.240Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=458270d4-5635-4dfa-b2bf-c8364e9713a6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:06.240292Z InvocationID=552f8d34-da56-4a82-8a6b-7bad6779d1d8 LogTimestamp=2021-04-14T13:18:06.240331Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:18:06.241Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:18:06.240Z InvocationID=b498d954-a617-438e-b78b-ad51f8c608f3 LogTimestamp=2021-04-14T13:18:06.241561Z ResponseDesc=OK Exiting. 2021-04-14T13:18:06.241Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:18:08.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b177b4f3-1ff5-4e0d-a07a-e56f24681a48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:08.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b177b4f3-1ff5-4e0d-a07a-e56f24681a48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f1e1e82 2021-04-14T13:18:08.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b177b4f3-1ff5-4e0d-a07a-e56f24681a48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:08.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b177b4f3-1ff5-4e0d-a07a-e56f24681a48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84f0ff32-36b2-4724-85e0-d0d61e71c2a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84f0ff32-36b2-4724-85e0-d0d61e71c2a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@21204b49 2021-04-14T13:18:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84f0ff32-36b2-4724-85e0-d0d61e71c2a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:12.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=84f0ff32-36b2-4724-85e0-d0d61e71c2a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:14.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=511feffb-e1a7-421c-9555-6b26d0dd41ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:14.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=511feffb-e1a7-421c-9555-6b26d0dd41ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c9c7b6a 2021-04-14T13:18:14.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=511feffb-e1a7-421c-9555-6b26d0dd41ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:14.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=511feffb-e1a7-421c-9555-6b26d0dd41ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:16.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:16.202Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:16.205Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:18.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1970d21c-91a9-434f-aeae-ee26df3c44fa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:18.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1970d21c-91a9-434f-aeae-ee26df3c44fa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7605b844 2021-04-14T13:18:18.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1970d21c-91a9-434f-aeae-ee26df3c44fa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:18.059Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1970d21c-91a9-434f-aeae-ee26df3c44fa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:19.832Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c0b2fcdf-95bd-4651-953d-4732d15d3ced InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:19.831753Z InvocationID=f7a38fc8-3ebd-467f-a5b5-1a628dd57bc9 LogTimestamp=2021-04-14T13:18:19.831813Z Entering 2021-04-14T13:18:19.832Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c0b2fcdf-95bd-4651-953d-4732d15d3ced InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:19.831753Z InvocationID=f7a38fc8-3ebd-467f-a5b5-1a628dd57bc9 LogTimestamp=2021-04-14T13:18:19.831813Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:18:19.833Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:18:19.832Z InvocationID=5d537e5e-f19d-4151-9eed-e673546c4fa1 LogTimestamp=2021-04-14T13:18:19.833745Z ResponseDesc=OK Exiting. 2021-04-14T13:18:19.834Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:18:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b088d3d5-01b3-4482-b242-a5d6672f684d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b088d3d5-01b3-4482-b242-a5d6672f684d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19804208 2021-04-14T13:18:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b088d3d5-01b3-4482-b242-a5d6672f684d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:20.556Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b088d3d5-01b3-4482-b242-a5d6672f684d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:24.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb63caa-ff64-4550-a521-e559eb1cf85d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:24.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb63caa-ff64-4550-a521-e559eb1cf85d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ad92872 2021-04-14T13:18:24.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb63caa-ff64-4550-a521-e559eb1cf85d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:24.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8fb63caa-ff64-4550-a521-e559eb1cf85d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:27.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c31af0-ed63-46ea-a498-839da2478741 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:27.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c31af0-ed63-46ea-a498-839da2478741 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35115368 2021-04-14T13:18:27.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c31af0-ed63-46ea-a498-839da2478741 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:27.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79c31af0-ed63-46ea-a498-839da2478741 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:28.373Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=dbf738e6-64e7-4468-b406-c5aefbcb9518 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:28.372914Z InvocationID=a4a089e9-84ed-4bc7-bbab-a3ea57054264 LogTimestamp=2021-04-14T13:18:28.372940Z Entering 2021-04-14T13:18:28.373Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=dbf738e6-64e7-4468-b406-c5aefbcb9518 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.13 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.13 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:28.372914Z InvocationID=a4a089e9-84ed-4bc7-bbab-a3ea57054264 LogTimestamp=2021-04-14T13:18:28.372940Z localAddr=10.242.62.146 remoteAddr=10.242.5.13 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:18:28.374Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.9.1) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:18:28.373Z InvocationID=26d661a6-d9ea-490f-af48-0adcf192648b LogTimestamp=2021-04-14T13:18:28.373947Z ResponseDesc=OK Exiting. 2021-04-14T13:18:28.374Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:18:29.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f256c682-9429-4ea2-9de8-d556a4d66029 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:29.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f256c682-9429-4ea2-9de8-d556a4d66029 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e0d0a16 2021-04-14T13:18:29.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f256c682-9429-4ea2-9de8-d556a4d66029 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:29.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f256c682-9429-4ea2-9de8-d556a4d66029 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74ae3f06-217e-46b0-a195-ef71616b3dee PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74ae3f06-217e-46b0-a195-ef71616b3dee PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@750685dd 2021-04-14T13:18:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74ae3f06-217e-46b0-a195-ef71616b3dee PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=74ae3f06-217e-46b0-a195-ef71616b3dee PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:35.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddae8e1e-07c1-47a3-9f01-0997e4b53760 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:35.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddae8e1e-07c1-47a3-9f01-0997e4b53760 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6efa9b7 2021-04-14T13:18:35.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddae8e1e-07c1-47a3-9f01-0997e4b53760 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:35.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ddae8e1e-07c1-47a3-9f01-0997e4b53760 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:36.243Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6850d804-2bd4-4772-baf0-a8585af87b77 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:36.243099Z InvocationID=d790e571-4849-4bd0-be52-8add271f8e92 LogTimestamp=2021-04-14T13:18:36.243197Z Entering 2021-04-14T13:18:36.243Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6850d804-2bd4-4772-baf0-a8585af87b77 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:18:36.243099Z InvocationID=d790e571-4849-4bd0-be52-8add271f8e92 LogTimestamp=2021-04-14T13:18:36.243197Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:18:36.245Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:18:36.244Z InvocationID=1408fc89-6e44-4b9f-8483-ad80bfd474f9 LogTimestamp=2021-04-14T13:18:36.245680Z ResponseDesc=OK Exiting. 2021-04-14T13:18:36.246Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:18:39.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e21b0432-7693-46cc-9aaf-3ed8266252b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:39.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e21b0432-7693-46cc-9aaf-3ed8266252b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@39da3011 2021-04-14T13:18:39.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e21b0432-7693-46cc-9aaf-3ed8266252b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:39.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e21b0432-7693-46cc-9aaf-3ed8266252b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59f9d9d7-5766-44c6-b1ab-65326832038c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59f9d9d7-5766-44c6-b1ab-65326832038c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f01c086 2021-04-14T13:18:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59f9d9d7-5766-44c6-b1ab-65326832038c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=59f9d9d7-5766-44c6-b1ab-65326832038c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786f0440-8c03-466d-bfff-43905bca4127 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786f0440-8c03-466d-bfff-43905bca4127 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e6882d6 2021-04-14T13:18:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786f0440-8c03-466d-bfff-43905bca4127 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=786f0440-8c03-466d-bfff-43905bca4127 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:18:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:18:47.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8285ece-74ad-46c4-bb97-ef0fe555828b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8285ece-74ad-46c4-bb97-ef0fe555828b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b13ebd 2021-04-14T13:18:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8285ece-74ad-46c4-bb97-ef0fe555828b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8285ece-74ad-46c4-bb97-ef0fe555828b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:51.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=801f13ac-4204-462f-8709-deadd23a03d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:51.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=801f13ac-4204-462f-8709-deadd23a03d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6d83dca2 2021-04-14T13:18:51.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=801f13ac-4204-462f-8709-deadd23a03d1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:51.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=801f13ac-4204-462f-8709-deadd23a03d1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:54.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e95379-9cbe-490b-90ca-143ec5e98896 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:54.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e95379-9cbe-490b-90ca-143ec5e98896 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5cb72464 2021-04-14T13:18:54.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e95379-9cbe-490b-90ca-143ec5e98896 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:54.048Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=22e95379-9cbe-490b-90ca-143ec5e98896 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:18:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8081fd18-1c23-4957-ab2f-d84203e231b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:18:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8081fd18-1c23-4957-ab2f-d84203e231b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66f36316 2021-04-14T13:18:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8081fd18-1c23-4957-ab2f-d84203e231b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:18:56.933Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8081fd18-1c23-4957-ab2f-d84203e231b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:00.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8a2cdf-d9cd-4c3c-b6c0-16821f175a58 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:00.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8a2cdf-d9cd-4c3c-b6c0-16821f175a58 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6a3bfda3 2021-04-14T13:19:00.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8a2cdf-d9cd-4c3c-b6c0-16821f175a58 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:00.140Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3a8a2cdf-d9cd-4c3c-b6c0-16821f175a58 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:02.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=278e0063-ade5-42a8-82ba-41f2f88c3d5d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=278e0063-ade5-42a8-82ba-41f2f88c3d5d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@192e4a8a 2021-04-14T13:19:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=278e0063-ade5-42a8-82ba-41f2f88c3d5d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:02.831Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=278e0063-ade5-42a8-82ba-41f2f88c3d5d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:19:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:19:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:19:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:19:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:19:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:19:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb274eca-f41b-497c-9bd3-922a209abb72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb274eca-f41b-497c-9bd3-922a209abb72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c5fc9cf 2021-04-14T13:19:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb274eca-f41b-497c-9bd3-922a209abb72 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb274eca-f41b-497c-9bd3-922a209abb72 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:06.230Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=eefd7114-ea59-484d-92a8-a1a97c7a9c68 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:06.230214Z InvocationID=b0600689-9720-457d-9da3-62143d066de8 LogTimestamp=2021-04-14T13:19:06.230266Z Entering 2021-04-14T13:19:06.230Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=eefd7114-ea59-484d-92a8-a1a97c7a9c68 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:06.230214Z InvocationID=b0600689-9720-457d-9da3-62143d066de8 LogTimestamp=2021-04-14T13:19:06.230266Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:19:06.233Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:19:06.231Z InvocationID=5c6f90e2-81fa-4191-bb0d-70867b473d64 LogTimestamp=2021-04-14T13:19:06.233059Z ResponseDesc=OK Exiting. 2021-04-14T13:19:06.233Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:19:08.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e461b6-57f9-4b79-a8fd-69359782b50e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:08.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e461b6-57f9-4b79-a8fd-69359782b50e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@149fe81 2021-04-14T13:19:08.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e461b6-57f9-4b79-a8fd-69359782b50e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:08.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=31e461b6-57f9-4b79-a8fd-69359782b50e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:12.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e43d006b-28e9-47cd-bd0b-7520f0839d14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e43d006b-28e9-47cd-bd0b-7520f0839d14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34aaddee 2021-04-14T13:19:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e43d006b-28e9-47cd-bd0b-7520f0839d14 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:12.046Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e43d006b-28e9-47cd-bd0b-7520f0839d14 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:14.713Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7c3949-70ea-472c-8046-14f1e69053c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:14.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7c3949-70ea-472c-8046-14f1e69053c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f3babeb 2021-04-14T13:19:14.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7c3949-70ea-472c-8046-14f1e69053c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:14.714Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7e7c3949-70ea-472c-8046-14f1e69053c0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:15.163Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=038b58e5-f7c5-40c2-901c-c65e85ad278b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:15.163011Z InvocationID=5187aa80-6b45-4f73-adc0-7f1e0ddee59a LogTimestamp=2021-04-14T13:19:15.163050Z Entering 2021-04-14T13:19:15.163Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=038b58e5-f7c5-40c2-901c-c65e85ad278b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:15.163011Z InvocationID=5187aa80-6b45-4f73-adc0-7f1e0ddee59a LogTimestamp=2021-04-14T13:19:15.163050Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:19:15.164Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:19:15.163Z InvocationID=e851a8a0-e0f8-438a-9542-ec0acbba7935 LogTimestamp=2021-04-14T13:19:15.164383Z ResponseDesc=OK Exiting. 2021-04-14T13:19:15.164Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:19:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=999530ae-5ab9-48fd-bccb-f8a53989dac3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=999530ae-5ab9-48fd-bccb-f8a53989dac3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5da80072 2021-04-14T13:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=999530ae-5ab9-48fd-bccb-f8a53989dac3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:18.106Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=999530ae-5ab9-48fd-bccb-f8a53989dac3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:20.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6719788-ebac-4f2b-b723-c391561a8bb3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:20.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6719788-ebac-4f2b-b723-c391561a8bb3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13db50b0 2021-04-14T13:19:20.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6719788-ebac-4f2b-b723-c391561a8bb3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:20.842Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c6719788-ebac-4f2b-b723-c391561a8bb3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:24.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f15ba5c-9a63-45f6-8e67-9053e612e68e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:24.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f15ba5c-9a63-45f6-8e67-9053e612e68e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@717cba88 2021-04-14T13:19:24.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f15ba5c-9a63-45f6-8e67-9053e612e68e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:24.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f15ba5c-9a63-45f6-8e67-9053e612e68e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:26.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77f66bfb-70c4-4ca4-837e-cd53491e19f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:26.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77f66bfb-70c4-4ca4-837e-cd53491e19f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@739a33bf 2021-04-14T13:19:26.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77f66bfb-70c4-4ca4-837e-cd53491e19f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:26.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=77f66bfb-70c4-4ca4-837e-cd53491e19f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:30.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806c6197-bb51-4f2f-a854-9d5300db07e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:30.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806c6197-bb51-4f2f-a854-9d5300db07e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6eac062e 2021-04-14T13:19:30.413Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806c6197-bb51-4f2f-a854-9d5300db07e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:30.414Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=806c6197-bb51-4f2f-a854-9d5300db07e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc86826e-9e3d-4393-bc2c-99a3bc044648 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc86826e-9e3d-4393-bc2c-99a3bc044648 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@273b959b 2021-04-14T13:19:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc86826e-9e3d-4393-bc2c-99a3bc044648 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc86826e-9e3d-4393-bc2c-99a3bc044648 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:36.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42ea0db1-049a-4562-8bd5-9c7c8d7243c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:36.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42ea0db1-049a-4562-8bd5-9c7c8d7243c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3387c30e 2021-04-14T13:19:36.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42ea0db1-049a-4562-8bd5-9c7c8d7243c3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:36.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42ea0db1-049a-4562-8bd5-9c7c8d7243c3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:36.234Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5d586e33-b48a-41ba-9386-5b4ac1bc30da InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:36.234285Z InvocationID=f198cba3-43ed-406c-b7e0-69b972757b74 LogTimestamp=2021-04-14T13:19:36.234325Z Entering 2021-04-14T13:19:36.234Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5d586e33-b48a-41ba-9386-5b4ac1bc30da InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:36.234285Z InvocationID=f198cba3-43ed-406c-b7e0-69b972757b74 LogTimestamp=2021-04-14T13:19:36.234325Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:19:36.235Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:19:36.235Z InvocationID=9665814a-d7ca-4b03-a4bc-73bff6cf7e23 LogTimestamp=2021-04-14T13:19:36.235836Z ResponseDesc=OK Exiting. 2021-04-14T13:19:36.236Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:19:39.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9282269c-2714-438f-8f60-7787ddd28f5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:39.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9282269c-2714-438f-8f60-7787ddd28f5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1122090a 2021-04-14T13:19:39.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9282269c-2714-438f-8f60-7787ddd28f5c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:39.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9282269c-2714-438f-8f60-7787ddd28f5c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:41.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b1242b3-b2f9-4602-bbf7-44f8d97fffd1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b1242b3-b2f9-4602-bbf7-44f8d97fffd1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f31f076 2021-04-14T13:19:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b1242b3-b2f9-4602-bbf7-44f8d97fffd1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6b1242b3-b2f9-4602-bbf7-44f8d97fffd1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:44.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=881abaff-7a82-4756-b2f9-a95a8989b39d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:44.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=881abaff-7a82-4756-b2f9-a95a8989b39d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@645d2946 2021-04-14T13:19:44.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=881abaff-7a82-4756-b2f9-a95a8989b39d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:44.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=881abaff-7a82-4756-b2f9-a95a8989b39d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:19:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:19:48.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce384fdd-a551-4bcc-8745-c3dc4ca1a446 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:48.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce384fdd-a551-4bcc-8745-c3dc4ca1a446 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69cf1970 2021-04-14T13:19:48.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce384fdd-a551-4bcc-8745-c3dc4ca1a446 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:48.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce384fdd-a551-4bcc-8745-c3dc4ca1a446 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:48.218Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=894014c7-12d4-4ae9-b2c2-89e4544b26e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:48.218139Z InvocationID=a7722b2f-6d27-4b1b-bf63-99cbcba4abca LogTimestamp=2021-04-14T13:19:48.218167Z Entering 2021-04-14T13:19:48.218Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=894014c7-12d4-4ae9-b2c2-89e4544b26e6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:19:48.218139Z InvocationID=a7722b2f-6d27-4b1b-bf63-99cbcba4abca LogTimestamp=2021-04-14T13:19:48.218167Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:19:48.219Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:19:48.218Z InvocationID=399aad18-55be-40db-b83f-6c68f33f4176 LogTimestamp=2021-04-14T13:19:48.219183Z ResponseDesc=OK Exiting. 2021-04-14T13:19:48.219Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:19:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb07d5c0-4e36-47ce-bf3c-3f56be0dcbe8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb07d5c0-4e36-47ce-bf3c-3f56be0dcbe8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6824371a 2021-04-14T13:19:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb07d5c0-4e36-47ce-bf3c-3f56be0dcbe8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:51.141Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb07d5c0-4e36-47ce-bf3c-3f56be0dcbe8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:54.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beb7243c-9a6e-4fe6-87f5-dfe1cd19cff2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:54.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beb7243c-9a6e-4fe6-87f5-dfe1cd19cff2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7806c828 2021-04-14T13:19:54.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beb7243c-9a6e-4fe6-87f5-dfe1cd19cff2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:54.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=beb7243c-9a6e-4fe6-87f5-dfe1cd19cff2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:19:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2c9d611-4242-4c31-aadb-332038728f0b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:19:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2c9d611-4242-4c31-aadb-332038728f0b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@751cd977 2021-04-14T13:19:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2c9d611-4242-4c31-aadb-332038728f0b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:19:57.038Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d2c9d611-4242-4c31-aadb-332038728f0b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:00.130Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517f2b05-b37e-4598-b583-beb5907e0d98 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517f2b05-b37e-4598-b583-beb5907e0d98 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64895a3d 2021-04-14T13:20:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517f2b05-b37e-4598-b583-beb5907e0d98 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:00.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=517f2b05-b37e-4598-b583-beb5907e0d98 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:02.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80f9a2c-0741-4639-bd52-80b1944dead7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:02.637Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80f9a2c-0741-4639-bd52-80b1944dead7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d5c2d51 2021-04-14T13:20:02.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80f9a2c-0741-4639-bd52-80b1944dead7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:02.638Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c80f9a2c-0741-4639-bd52-80b1944dead7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:20:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:20:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:20:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:20:04.357Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:20:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:20:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16462f6-8801-4206-9735-b8987754b91b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16462f6-8801-4206-9735-b8987754b91b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63d5e75a 2021-04-14T13:20:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16462f6-8801-4206-9735-b8987754b91b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:06.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f16462f6-8801-4206-9735-b8987754b91b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:06.237Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9a2349cd-c4fb-400f-be49-0e24e42d799a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:20:06.237287Z InvocationID=c396d6c4-78aa-4528-9b39-46249ae09b0e LogTimestamp=2021-04-14T13:20:06.237349Z Entering 2021-04-14T13:20:06.238Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9a2349cd-c4fb-400f-be49-0e24e42d799a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:20:06.237287Z InvocationID=c396d6c4-78aa-4528-9b39-46249ae09b0e LogTimestamp=2021-04-14T13:20:06.237349Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:20:06.239Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:20:06.238Z InvocationID=f375bfe9-3ebd-4179-a5e1-538783e67226 LogTimestamp=2021-04-14T13:20:06.239896Z ResponseDesc=OK Exiting. 2021-04-14T13:20:06.240Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:20:09.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdedac15-e007-4ad1-b58e-30ff331ec632 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:09.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdedac15-e007-4ad1-b58e-30ff331ec632 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@70114d36 2021-04-14T13:20:09.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdedac15-e007-4ad1-b58e-30ff331ec632 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:09.004Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cdedac15-e007-4ad1-b58e-30ff331ec632 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:12.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7747f1a5-5c3b-4cd5-8e22-98a743b061d3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:12.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7747f1a5-5c3b-4cd5-8e22-98a743b061d3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e67b9bb 2021-04-14T13:20:12.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7747f1a5-5c3b-4cd5-8e22-98a743b061d3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:12.231Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7747f1a5-5c3b-4cd5-8e22-98a743b061d3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:15.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bcdc62-7477-469f-a10f-33389b32d985 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:15.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bcdc62-7477-469f-a10f-33389b32d985 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@129d3183 2021-04-14T13:20:15.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bcdc62-7477-469f-a10f-33389b32d985 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:15.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0bcdc62-7477-469f-a10f-33389b32d985 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:16.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:18.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95f2a987-9d3a-4d35-83aa-3a0912e98f2d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:18.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95f2a987-9d3a-4d35-83aa-3a0912e98f2d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e3eebbd 2021-04-14T13:20:18.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95f2a987-9d3a-4d35-83aa-3a0912e98f2d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:18.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95f2a987-9d3a-4d35-83aa-3a0912e98f2d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a59f887-ae25-4f29-a5a1-414487f98d9d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a59f887-ae25-4f29-a5a1-414487f98d9d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@243c65b1 2021-04-14T13:20:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a59f887-ae25-4f29-a5a1-414487f98d9d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8a59f887-ae25-4f29-a5a1-414487f98d9d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10ae7a60-cb29-409a-a137-40e63bf9e9a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10ae7a60-cb29-409a-a137-40e63bf9e9a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4775aaec 2021-04-14T13:20:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10ae7a60-cb29-409a-a137-40e63bf9e9a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10ae7a60-cb29-409a-a137-40e63bf9e9a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:26.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c4be86-4504-4cd2-8270-12a57bbf5235 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:26.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c4be86-4504-4cd2-8270-12a57bbf5235 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c9f8aa8 2021-04-14T13:20:26.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c4be86-4504-4cd2-8270-12a57bbf5235 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:26.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49c4be86-4504-4cd2-8270-12a57bbf5235 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60c370e8-0df5-43e2-bdd3-d41be78cb055 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60c370e8-0df5-43e2-bdd3-d41be78cb055 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1555ed85 2021-04-14T13:20:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60c370e8-0df5-43e2-bdd3-d41be78cb055 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60c370e8-0df5-43e2-bdd3-d41be78cb055 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0091803-e705-4b5d-a37f-cfdc71c7eb0f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0091803-e705-4b5d-a37f-cfdc71c7eb0f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52830373 2021-04-14T13:20:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0091803-e705-4b5d-a37f-cfdc71c7eb0f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:33.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0091803-e705-4b5d-a37f-cfdc71c7eb0f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:34.636Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0go3pmfz44r9n1yg56g5pjus4462 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node08isvzqvtq4471bgd50bsl7yu6467 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qu0r8iwk9sby16z68y7qh8891459 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0j5223r3zp4mxq0upxzqmh55h474 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02tiehkm38gfd18r0tfbzc2jbp445 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01rdvz3kbkhhauucvt7o5wyvlw441 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01ojilpjoxs2h1supcr4z9214x458 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node080ptipj9gmms1mz6mkh92k5ri468 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node09ke3mlmmouqao8s6x59s6zym447 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01xopo1ed4787n1h9rx1f1b0akq464 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0tcewsc18idsg1vupfskt9r1l3443 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mcbhabi5zsmc1jbfgoo81yd8c448 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xnkxx17ox2888wv037zu3xnv455 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01dqbmbp2a92ch3rktyx9bsd60472 2021-04-14T13:20:34.637Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0l73r4eud7blz1rg8i782sf3p2452 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bzlid79ojgu31pgvvvhtgard2471 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016nwja2pa7o83g8uj07enqioo444 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0h9ci0w3qxlu4habmhzqtapdo449 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node011w7l2bimhc7qdt91ejnuvl2b461 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01iilqb1ufdv7s254cgi8v66ig465 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node02lk2pzp77qlmicrzc146iye3466 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0175ywbarvfani1vwu722e5hcc6442 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010sctq57fa45c9lykndkou44b477 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qkx3zcwpga8i34pszca09w27454 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0vxv4vfbrzgu6y3f36jqxrd03469 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01s2p5ha723hbacktf27ayeqpk457 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0eygfnfecu92q1dmco4wckbokm478 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0p74ufhdwdb3097jr1x23ves3479 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0w6h7ul6lha2612cd47u3borvs473 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0m718028peim14xclxnuvi0eg451 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01upz7qjryqfez1fx5rnxivv35m475 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0guywr1c7l9bq9b27wu61w0ze450 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01sr7fiwjo07yyy4ykvyqul0un480 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lsk0567j6pvg96rsixqezxl5453 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01roctbvvuo42m1r5swm8l2e2zj456 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0153ou2l5p05s017byntx74epn5460 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0yfryxfvyef6y1f0x3go5lajro481 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0o6eb5birptcqhrc33x5tkcjy470 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01jwtob8bo4ajt1sg18gumu14vh476 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0pb6zu6294ec8ysqqtsyn0pr9446 2021-04-14T13:20:34.638Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010thaisxbb00cmnfxz31a3pmu463 2021-04-14T13:20:35.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61729d84-f10c-4bf9-8892-6c0925db92d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:35.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61729d84-f10c-4bf9-8892-6c0925db92d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38cbe105 2021-04-14T13:20:35.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61729d84-f10c-4bf9-8892-6c0925db92d5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:35.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61729d84-f10c-4bf9-8892-6c0925db92d5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:36.236Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ecb8a9c0-672a-46a3-8e7f-f09fa90ba4fd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:20:36.235731Z InvocationID=db2eb0e7-819e-4d70-bc71-1b7a8b76dfbd LogTimestamp=2021-04-14T13:20:36.235801Z Entering 2021-04-14T13:20:36.236Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ecb8a9c0-672a-46a3-8e7f-f09fa90ba4fd InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:20:36.235731Z InvocationID=db2eb0e7-819e-4d70-bc71-1b7a8b76dfbd LogTimestamp=2021-04-14T13:20:36.235801Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:20:36.238Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:20:36.236Z InvocationID=9de7158e-d4dc-460b-8499-c61cc1500df8 LogTimestamp=2021-04-14T13:20:36.238559Z ResponseDesc=OK Exiting. 2021-04-14T13:20:36.238Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:20:38.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99951b7a-873b-4181-9c34-5870a946e4d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:38.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99951b7a-873b-4181-9c34-5870a946e4d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78c1e67e 2021-04-14T13:20:38.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99951b7a-873b-4181-9c34-5870a946e4d5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:38.956Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99951b7a-873b-4181-9c34-5870a946e4d5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d940936-d9e0-4ad5-a508-20a34ced97ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d940936-d9e0-4ad5-a508-20a34ced97ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42c20526 2021-04-14T13:20:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d940936-d9e0-4ad5-a508-20a34ced97ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d940936-d9e0-4ad5-a508-20a34ced97ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d0f49be-3531-4e57-aeab-a84476426d84 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d0f49be-3531-4e57-aeab-a84476426d84 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8101e96 2021-04-14T13:20:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d0f49be-3531-4e57-aeab-a84476426d84 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:45.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d0f49be-3531-4e57-aeab-a84476426d84 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:20:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:20:48.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7d1b459-e339-46e6-8135-83381478941c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:48.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7d1b459-e339-46e6-8135-83381478941c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6fb40558 2021-04-14T13:20:48.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7d1b459-e339-46e6-8135-83381478941c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:48.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7d1b459-e339-46e6-8135-83381478941c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e59b3be-eb24-4df1-a8d9-b228cf292e30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e59b3be-eb24-4df1-a8d9-b228cf292e30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18b1fcc6 2021-04-14T13:20:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e59b3be-eb24-4df1-a8d9-b228cf292e30 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:51.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e59b3be-eb24-4df1-a8d9-b228cf292e30 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=427be9b8-ac67-4122-aca6-b5ce2db6b275 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=427be9b8-ac67-4122-aca6-b5ce2db6b275 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a8821c3 2021-04-14T13:20:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=427be9b8-ac67-4122-aca6-b5ce2db6b275 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=427be9b8-ac67-4122-aca6-b5ce2db6b275 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e762a6d0-9fa4-46c4-8926-e5c343d36d9f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e762a6d0-9fa4-46c4-8926-e5c343d36d9f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@426472aa 2021-04-14T13:20:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e762a6d0-9fa4-46c4-8926-e5c343d36d9f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:57.045Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e762a6d0-9fa4-46c4-8926-e5c343d36d9f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:20:59.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c05651f-d2a4-4da6-b54d-6df055bf5163 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:20:59.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c05651f-d2a4-4da6-b54d-6df055bf5163 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@db5317b 2021-04-14T13:20:59.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c05651f-d2a4-4da6-b54d-6df055bf5163 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:20:59.597Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c05651f-d2a4-4da6-b54d-6df055bf5163 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:02.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=901bdce4-51ea-4f5e-a57a-151e00526a70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:02.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=901bdce4-51ea-4f5e-a57a-151e00526a70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a75bbc7 2021-04-14T13:21:02.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=901bdce4-51ea-4f5e-a57a-151e00526a70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:02.813Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=901bdce4-51ea-4f5e-a57a-151e00526a70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:21:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:21:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:21:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:21:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:21:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:21:05.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42abaa4a-6b66-472b-ae0f-72497c78a4a4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:05.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42abaa4a-6b66-472b-ae0f-72497c78a4a4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11780773 2021-04-14T13:21:05.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42abaa4a-6b66-472b-ae0f-72497c78a4a4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:05.921Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=42abaa4a-6b66-472b-ae0f-72497c78a4a4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:06.231Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5c064a6b-374c-425b-aa13-116628de8947 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:06.231785Z InvocationID=2f82d43a-8cbc-4b68-a155-61257a4e9d94 LogTimestamp=2021-04-14T13:21:06.231825Z Entering 2021-04-14T13:21:06.232Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5c064a6b-374c-425b-aa13-116628de8947 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:06.231785Z InvocationID=2f82d43a-8cbc-4b68-a155-61257a4e9d94 LogTimestamp=2021-04-14T13:21:06.231825Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:21:06.232Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:21:06.232Z InvocationID=8a51cd85-7c4f-418e-bcf8-a2d82f083c16 LogTimestamp=2021-04-14T13:21:06.232917Z ResponseDesc=OK Exiting. 2021-04-14T13:21:06.233Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:21:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5629fb49-38e3-4155-a623-aa6da3d88cbd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5629fb49-38e3-4155-a623-aa6da3d88cbd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7068c6d4 2021-04-14T13:21:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5629fb49-38e3-4155-a623-aa6da3d88cbd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:09.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5629fb49-38e3-4155-a623-aa6da3d88cbd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d90de33-f6c8-41db-bda5-f26d64c1221a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d90de33-f6c8-41db-bda5-f26d64c1221a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54721f4b 2021-04-14T13:21:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d90de33-f6c8-41db-bda5-f26d64c1221a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d90de33-f6c8-41db-bda5-f26d64c1221a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:14.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9c428d-d211-4509-9d4b-3f5e77302c59 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:14.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9c428d-d211-4509-9d4b-3f5e77302c59 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@636e3d81 2021-04-14T13:21:14.621Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9c428d-d211-4509-9d4b-3f5e77302c59 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:14.622Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb9c428d-d211-4509-9d4b-3f5e77302c59 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:15.187Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=88f0e117-a989-4fe0-952c-bdebd546b4de InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:15.186736Z InvocationID=0c543459-dbf6-4cb2-a595-1d412266d7fb LogTimestamp=2021-04-14T13:21:15.186781Z Entering 2021-04-14T13:21:15.187Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=88f0e117-a989-4fe0-952c-bdebd546b4de InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:15.186736Z InvocationID=0c543459-dbf6-4cb2-a595-1d412266d7fb LogTimestamp=2021-04-14T13:21:15.186781Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:21:15.188Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:21:15.187Z InvocationID=01ba6230-53ef-4e77-8495-bc8877e858a2 LogTimestamp=2021-04-14T13:21:15.188495Z ResponseDesc=OK Exiting. 2021-04-14T13:21:15.188Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:21:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e90764-9473-4f44-a1f0-18cda5b8275e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e90764-9473-4f44-a1f0-18cda5b8275e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@327cfd00 2021-04-14T13:21:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e90764-9473-4f44-a1f0-18cda5b8275e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:18.088Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d4e90764-9473-4f44-a1f0-18cda5b8275e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28fc68af-9f34-46ee-a9aa-ab466740a75e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28fc68af-9f34-46ee-a9aa-ab466740a75e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@414d3fd 2021-04-14T13:21:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28fc68af-9f34-46ee-a9aa-ab466740a75e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28fc68af-9f34-46ee-a9aa-ab466740a75e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0dd5f1-9c88-4c8d-b735-a8acbf81ea7f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0dd5f1-9c88-4c8d-b735-a8acbf81ea7f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40580c73 2021-04-14T13:21:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0dd5f1-9c88-4c8d-b735-a8acbf81ea7f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:24.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4f0dd5f1-9c88-4c8d-b735-a8acbf81ea7f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be16943-6c15-4e83-b657-2af368f07f4c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be16943-6c15-4e83-b657-2af368f07f4c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5248b3cc 2021-04-14T13:21:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be16943-6c15-4e83-b657-2af368f07f4c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3be16943-6c15-4e83-b657-2af368f07f4c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9fed19a-e020-4482-8e2c-817dd975a524 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9fed19a-e020-4482-8e2c-817dd975a524 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@789c078 2021-04-14T13:21:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9fed19a-e020-4482-8e2c-817dd975a524 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:30.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9fed19a-e020-4482-8e2c-817dd975a524 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=993e2dfd-6d09-465e-833f-6a41e56d9aca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=993e2dfd-6d09-465e-833f-6a41e56d9aca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2520604f 2021-04-14T13:21:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=993e2dfd-6d09-465e-833f-6a41e56d9aca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:33.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=993e2dfd-6d09-465e-833f-6a41e56d9aca PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1988a99e-897d-4e6e-9249-4854d504c0a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1988a99e-897d-4e6e-9249-4854d504c0a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@259bdb0c 2021-04-14T13:21:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1988a99e-897d-4e6e-9249-4854d504c0a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:35.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1988a99e-897d-4e6e-9249-4854d504c0a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:36.236Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2eafd605-8a82-404e-8949-331058795e97 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:36.236331Z InvocationID=b3db3488-2e40-4060-905f-48cd456e6e60 LogTimestamp=2021-04-14T13:21:36.236388Z Entering 2021-04-14T13:21:36.237Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2eafd605-8a82-404e-8949-331058795e97 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:36.236331Z InvocationID=b3db3488-2e40-4060-905f-48cd456e6e60 LogTimestamp=2021-04-14T13:21:36.236388Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:21:36.238Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:21:36.237Z InvocationID=ab07b6d2-0994-49c5-a18c-c21691b12437 LogTimestamp=2021-04-14T13:21:36.238414Z ResponseDesc=OK Exiting. 2021-04-14T13:21:36.238Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:21:38.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d23f90da-e60a-45ae-9423-cd6ce61dbe27 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:38.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d23f90da-e60a-45ae-9423-cd6ce61dbe27 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32dadaa0 2021-04-14T13:21:38.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d23f90da-e60a-45ae-9423-cd6ce61dbe27 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:38.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d23f90da-e60a-45ae-9423-cd6ce61dbe27 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adfa9e8-61aa-45e0-847e-68bd0da2539c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adfa9e8-61aa-45e0-847e-68bd0da2539c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b994683 2021-04-14T13:21:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adfa9e8-61aa-45e0-847e-68bd0da2539c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:41.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4adfa9e8-61aa-45e0-847e-68bd0da2539c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:41.991Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4587a86a-38fe-4b73-a1fb-b8304e076578 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:41.991188Z InvocationID=227276c3-4a7c-4061-acad-79756f52b6a1 LogTimestamp=2021-04-14T13:21:41.991232Z Entering 2021-04-14T13:21:41.991Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4587a86a-38fe-4b73-a1fb-b8304e076578 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:41.991188Z InvocationID=227276c3-4a7c-4061-acad-79756f52b6a1 LogTimestamp=2021-04-14T13:21:41.991232Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:21:41.992Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:21:41.991Z InvocationID=c898f17b-ab63-4b35-9a82-9a48f382b7bc LogTimestamp=2021-04-14T13:21:41.992537Z ResponseDesc=OK Exiting. 2021-04-14T13:21:41.992Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:21:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56f02744-a649-45f9-a3f8-3d27f2a12511 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56f02744-a649-45f9-a3f8-3d27f2a12511 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d1d73a7 2021-04-14T13:21:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56f02744-a649-45f9-a3f8-3d27f2a12511 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:45.113Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56f02744-a649-45f9-a3f8-3d27f2a12511 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:21:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:21:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860b721c-bf9c-4cf0-8cab-779118732e96 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860b721c-bf9c-4cf0-8cab-779118732e96 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@26a590b3 2021-04-14T13:21:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860b721c-bf9c-4cf0-8cab-779118732e96 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:47.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=860b721c-bf9c-4cf0-8cab-779118732e96 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:48.217Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0c2a1a57-c500-4530-83da-70edf1fd3259 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:48.216691Z InvocationID=7d635713-45ca-40ed-b1c3-ea3c08a98567 LogTimestamp=2021-04-14T13:21:48.216767Z Entering 2021-04-14T13:21:48.217Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0c2a1a57-c500-4530-83da-70edf1fd3259 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:21:48.216691Z InvocationID=7d635713-45ca-40ed-b1c3-ea3c08a98567 LogTimestamp=2021-04-14T13:21:48.216767Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:21:48.220Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:21:48.217Z InvocationID=73a7fe2f-c789-4799-826c-e74e220aca09 LogTimestamp=2021-04-14T13:21:48.219930Z ResponseDesc=OK Exiting. 2021-04-14T13:21:48.220Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:21:51.143Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=268ff91c-9a14-4f32-8228-980d32185709 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:51.143Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=268ff91c-9a14-4f32-8228-980d32185709 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ce411d 2021-04-14T13:21:51.143Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=268ff91c-9a14-4f32-8228-980d32185709 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:51.143Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=268ff91c-9a14-4f32-8228-980d32185709 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b91ae5-9782-45b4-954d-32324724c4a0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b91ae5-9782-45b4-954d-32324724c4a0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73d2ba99 2021-04-14T13:21:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b91ae5-9782-45b4-954d-32324724c4a0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:53.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72b91ae5-9782-45b4-954d-32324724c4a0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:56.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c72396b7-f574-4544-8996-582ed86ae7c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c72396b7-f574-4544-8996-582ed86ae7c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@45646f0f 2021-04-14T13:21:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c72396b7-f574-4544-8996-582ed86ae7c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:56.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c72396b7-f574-4544-8996-582ed86ae7c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:21:59.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9701369c-477d-4bd3-aa6e-c8e25095e8b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:21:59.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9701369c-477d-4bd3-aa6e-c8e25095e8b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f4e5f18 2021-04-14T13:21:59.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9701369c-477d-4bd3-aa6e-c8e25095e8b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:21:59.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9701369c-477d-4bd3-aa6e-c8e25095e8b8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:01.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:01.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32781303-086c-4f56-b397-b43add618acc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32781303-086c-4f56-b397-b43add618acc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fb82945 2021-04-14T13:22:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32781303-086c-4f56-b397-b43add618acc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:03.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32781303-086c-4f56-b397-b43add618acc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:22:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:22:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:22:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:22:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:22:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:22:05.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eb0703d-6856-4aa9-aea8-527d9cbc77b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:05.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eb0703d-6856-4aa9-aea8-527d9cbc77b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@19d84259 2021-04-14T13:22:05.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eb0703d-6856-4aa9-aea8-527d9cbc77b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:05.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eb0703d-6856-4aa9-aea8-527d9cbc77b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:06.245Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ed7a846a-47f0-48fe-9f92-3ec20af2c6b4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:22:06.245129Z InvocationID=ae22cf61-6d62-4243-b297-6c668af356a9 LogTimestamp=2021-04-14T13:22:06.245164Z Entering 2021-04-14T13:22:06.245Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ed7a846a-47f0-48fe-9f92-3ec20af2c6b4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:22:06.245129Z InvocationID=ae22cf61-6d62-4243-b297-6c668af356a9 LogTimestamp=2021-04-14T13:22:06.245164Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:22:06.246Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:22:06.245Z InvocationID=188e105b-489e-4512-97f4-d9ad429e24d3 LogTimestamp=2021-04-14T13:22:06.246820Z ResponseDesc=OK Exiting. 2021-04-14T13:22:06.247Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:22:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7eb8f69-832d-4d14-afc3-491de162c8b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7eb8f69-832d-4d14-afc3-491de162c8b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f225a7a 2021-04-14T13:22:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7eb8f69-832d-4d14-afc3-491de162c8b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c7eb8f69-832d-4d14-afc3-491de162c8b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bca4e46-112e-429a-9551-661030a7223c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bca4e46-112e-429a-9551-661030a7223c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42297c19 2021-04-14T13:22:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bca4e46-112e-429a-9551-661030a7223c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:11.925Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1bca4e46-112e-429a-9551-661030a7223c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=937be2bf-4d8b-42cc-b854-ecb703144df1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=937be2bf-4d8b-42cc-b854-ecb703144df1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7ce59718 2021-04-14T13:22:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=937be2bf-4d8b-42cc-b854-ecb703144df1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=937be2bf-4d8b-42cc-b854-ecb703144df1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:16.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:16.200Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:16.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8160d353-178c-4b9e-91a5-e76877da8fea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8160d353-178c-4b9e-91a5-e76877da8fea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2774c857 2021-04-14T13:22:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8160d353-178c-4b9e-91a5-e76877da8fea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8160d353-178c-4b9e-91a5-e76877da8fea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11cd4fde-1b4c-4d4f-8295-08f4c312743f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11cd4fde-1b4c-4d4f-8295-08f4c312743f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae8a749 2021-04-14T13:22:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11cd4fde-1b4c-4d4f-8295-08f4c312743f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:20.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=11cd4fde-1b4c-4d4f-8295-08f4c312743f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176dc5e2-0a5d-48d5-bcfd-6d5c6f832387 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176dc5e2-0a5d-48d5-bcfd-6d5c6f832387 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43a8c3b9 2021-04-14T13:22:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176dc5e2-0a5d-48d5-bcfd-6d5c6f832387 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:24.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=176dc5e2-0a5d-48d5-bcfd-6d5c6f832387 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eeb24a8c-9c64-4bd2-afab-d8cd99452e1a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eeb24a8c-9c64-4bd2-afab-d8cd99452e1a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1325c183 2021-04-14T13:22:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eeb24a8c-9c64-4bd2-afab-d8cd99452e1a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:27.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eeb24a8c-9c64-4bd2-afab-d8cd99452e1a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:30.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6cfa05-bbda-41d2-bc78-2da86e411dda PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:30.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6cfa05-bbda-41d2-bc78-2da86e411dda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@121295c0 2021-04-14T13:22:30.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6cfa05-bbda-41d2-bc78-2da86e411dda PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:30.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d6cfa05-bbda-41d2-bc78-2da86e411dda PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56fb3f37-b8c2-4a36-9771-0f279b0501c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56fb3f37-b8c2-4a36-9771-0f279b0501c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d4fba24 2021-04-14T13:22:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56fb3f37-b8c2-4a36-9771-0f279b0501c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:33.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=56fb3f37-b8c2-4a36-9771-0f279b0501c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:35.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=920e6acf-d1a3-4f83-a7ab-a1f2e231f953 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:35.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=920e6acf-d1a3-4f83-a7ab-a1f2e231f953 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18ff073f 2021-04-14T13:22:35.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=920e6acf-d1a3-4f83-a7ab-a1f2e231f953 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:35.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=920e6acf-d1a3-4f83-a7ab-a1f2e231f953 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:36.231Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b774fa2c-63f5-4022-8531-299b8dd79fec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:22:36.231415Z InvocationID=a6a7569a-fc5f-43cf-b150-6fd713902ba9 LogTimestamp=2021-04-14T13:22:36.231467Z Entering 2021-04-14T13:22:36.231Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b774fa2c-63f5-4022-8531-299b8dd79fec InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:22:36.231415Z InvocationID=a6a7569a-fc5f-43cf-b150-6fd713902ba9 LogTimestamp=2021-04-14T13:22:36.231467Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:22:36.233Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:22:36.231Z InvocationID=2818dcf8-a108-42b2-8a5a-d6038046b0c3 LogTimestamp=2021-04-14T13:22:36.232986Z ResponseDesc=OK Exiting. 2021-04-14T13:22:36.233Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:22:38.833Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826f5904-5e31-4600-9665-65e77b427bfc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:38.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826f5904-5e31-4600-9665-65e77b427bfc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@256bf47a 2021-04-14T13:22:38.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826f5904-5e31-4600-9665-65e77b427bfc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:38.834Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=826f5904-5e31-4600-9665-65e77b427bfc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7877c9d-6175-49ff-8b5c-2eb3d1eae3f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7877c9d-6175-49ff-8b5c-2eb3d1eae3f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@23d1c982 2021-04-14T13:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7877c9d-6175-49ff-8b5c-2eb3d1eae3f5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:41.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f7877c9d-6175-49ff-8b5c-2eb3d1eae3f5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:45.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244fddab-39e0-4739-ab15-90d0e5f982bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:45.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244fddab-39e0-4739-ab15-90d0e5f982bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@432fd946 2021-04-14T13:22:45.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244fddab-39e0-4739-ab15-90d0e5f982bd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:45.011Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=244fddab-39e0-4739-ab15-90d0e5f982bd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:22:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:22:47.997Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3221258c-a9e4-48e8-b9e8-192eb8311a29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:47.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3221258c-a9e4-48e8-b9e8-192eb8311a29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2309f8e3 2021-04-14T13:22:47.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3221258c-a9e4-48e8-b9e8-192eb8311a29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:47.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3221258c-a9e4-48e8-b9e8-192eb8311a29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:51.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4a7ca9-0eae-4e26-9d28-a4ba98eebbda PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:51.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4a7ca9-0eae-4e26-9d28-a4ba98eebbda PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@593b10dc 2021-04-14T13:22:51.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4a7ca9-0eae-4e26-9d28-a4ba98eebbda PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:51.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d4a7ca9-0eae-4e26-9d28-a4ba98eebbda PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:53.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e051cf-28c8-499b-ab51-b4cc8593adc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:53.581Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e051cf-28c8-499b-ab51-b4cc8593adc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@748b4fa0 2021-04-14T13:22:53.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e051cf-28c8-499b-ab51-b4cc8593adc5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:53.582Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66e051cf-28c8-499b-ab51-b4cc8593adc5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:57.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc27880e-e57f-4e65-8481-7f32c13c3455 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:57.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc27880e-e57f-4e65-8481-7f32c13c3455 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49d35d9e 2021-04-14T13:22:57.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc27880e-e57f-4e65-8481-7f32c13c3455 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:57.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc27880e-e57f-4e65-8481-7f32c13c3455 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:22:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7218125c-4114-4996-8246-730170c3af6a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:22:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7218125c-4114-4996-8246-730170c3af6a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25717aa7 2021-04-14T13:22:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7218125c-4114-4996-8246-730170c3af6a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:22:59.599Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7218125c-4114-4996-8246-730170c3af6a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:02.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c5de369-6621-4224-8906-4a6c00c9df06 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c5de369-6621-4224-8906-4a6c00c9df06 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24cd3325 2021-04-14T13:23:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c5de369-6621-4224-8906-4a6c00c9df06 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9c5de369-6621-4224-8906-4a6c00c9df06 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:23:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:23:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:23:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:23:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:23:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:23:06.234Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=60295933-5067-4ba8-bebd-6cc750fa6fd1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:23:06.233915Z InvocationID=67b49417-a27f-4bb8-b793-9f764d27202e LogTimestamp=2021-04-14T13:23:06.233967Z Entering 2021-04-14T13:23:06.234Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=60295933-5067-4ba8-bebd-6cc750fa6fd1 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:23:06.233915Z InvocationID=67b49417-a27f-4bb8-b793-9f764d27202e LogTimestamp=2021-04-14T13:23:06.233967Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:23:06.236Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:23:06.234Z InvocationID=20bb6d8e-5f0d-4cb3-afdc-e7292925f514 LogTimestamp=2021-04-14T13:23:06.236287Z ResponseDesc=OK Exiting. 2021-04-14T13:23:06.236Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:23:06.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f24b6847-a1ac-4c0b-9d2e-acb94e9e4670 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:06.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f24b6847-a1ac-4c0b-9d2e-acb94e9e4670 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a958e53 2021-04-14T13:23:06.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f24b6847-a1ac-4c0b-9d2e-acb94e9e4670 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:06.285Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f24b6847-a1ac-4c0b-9d2e-acb94e9e4670 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:08.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d684eee1-91bd-4f36-ae3a-9098d1ae4da9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:08.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d684eee1-91bd-4f36-ae3a-9098d1ae4da9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59790d32 2021-04-14T13:23:08.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d684eee1-91bd-4f36-ae3a-9098d1ae4da9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:08.700Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d684eee1-91bd-4f36-ae3a-9098d1ae4da9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50279b54-40bd-4d12-84d9-1bad1715d008 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50279b54-40bd-4d12-84d9-1bad1715d008 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7773e0f8 2021-04-14T13:23:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50279b54-40bd-4d12-84d9-1bad1715d008 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:11.934Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50279b54-40bd-4d12-84d9-1bad1715d008 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8d0265b-3cb3-43d8-8b8a-3a86702a7615 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8d0265b-3cb3-43d8-8b8a-3a86702a7615 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a6ab128 2021-04-14T13:23:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8d0265b-3cb3-43d8-8b8a-3a86702a7615 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:14.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8d0265b-3cb3-43d8-8b8a-3a86702a7615 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:16.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:16.201Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebf97eb-61d2-441a-91e3-6b5798cc64ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebf97eb-61d2-441a-91e3-6b5798cc64ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cab5720 2021-04-14T13:23:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebf97eb-61d2-441a-91e3-6b5798cc64ca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:18.102Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bebf97eb-61d2-441a-91e3-6b5798cc64ca PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b6277a1-56a5-4d44-ab27-6808b7d36217 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b6277a1-56a5-4d44-ab27-6808b7d36217 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d2ac91a 2021-04-14T13:23:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b6277a1-56a5-4d44-ab27-6808b7d36217 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:20.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b6277a1-56a5-4d44-ab27-6808b7d36217 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c2b5ec-a9ed-4e21-9d23-83a64f5d9930 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c2b5ec-a9ed-4e21-9d23-83a64f5d9930 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65369c67 2021-04-14T13:23:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c2b5ec-a9ed-4e21-9d23-83a64f5d9930 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=25c2b5ec-a9ed-4e21-9d23-83a64f5d9930 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:27.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115d2e2c-9b4b-4a41-aa6a-e0668f5b6ead PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:27.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115d2e2c-9b4b-4a41-aa6a-e0668f5b6ead PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a3a8218 2021-04-14T13:23:27.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115d2e2c-9b4b-4a41-aa6a-e0668f5b6ead PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:27.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=115d2e2c-9b4b-4a41-aa6a-e0668f5b6ead PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1f2e4c-2b92-4756-9db7-546807bae41f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1f2e4c-2b92-4756-9db7-546807bae41f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ceed628 2021-04-14T13:23:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1f2e4c-2b92-4756-9db7-546807bae41f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:29.920Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a1f2e4c-2b92-4756-9db7-546807bae41f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:33.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ed445de-1057-4466-a2ae-cd29f1ade769 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:33.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ed445de-1057-4466-a2ae-cd29f1ade769 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17d7a4b6 2021-04-14T13:23:33.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ed445de-1057-4466-a2ae-cd29f1ade769 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:33.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ed445de-1057-4466-a2ae-cd29f1ade769 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9776457f-2ea5-4318-bd26-1b40d9abb91d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9776457f-2ea5-4318-bd26-1b40d9abb91d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@46d3d78f 2021-04-14T13:23:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9776457f-2ea5-4318-bd26-1b40d9abb91d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:35.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9776457f-2ea5-4318-bd26-1b40d9abb91d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:36.234Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=7eb7901f-3909-48de-a2c3-0b3c1d1e8608 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:23:36.233906Z InvocationID=50f745d9-dded-4bc2-a8e9-ded71e740f56 LogTimestamp=2021-04-14T13:23:36.233956Z Entering 2021-04-14T13:23:36.234Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=7eb7901f-3909-48de-a2c3-0b3c1d1e8608 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:23:36.233906Z InvocationID=50f745d9-dded-4bc2-a8e9-ded71e740f56 LogTimestamp=2021-04-14T13:23:36.233956Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:23:36.235Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:23:36.234Z InvocationID=c4c1cdeb-7e77-4b6d-8227-16df4ad73b9b LogTimestamp=2021-04-14T13:23:36.235441Z ResponseDesc=OK Exiting. 2021-04-14T13:23:36.235Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:23:39.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab9ea22a-293a-411b-bff3-cd1dd128cee7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:39.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab9ea22a-293a-411b-bff3-cd1dd128cee7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18a7a70f 2021-04-14T13:23:39.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab9ea22a-293a-411b-bff3-cd1dd128cee7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:39.052Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab9ea22a-293a-411b-bff3-cd1dd128cee7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:41.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b0ff743-41e3-4d48-9537-34b55a64a193 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:41.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b0ff743-41e3-4d48-9537-34b55a64a193 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22c27da5 2021-04-14T13:23:41.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b0ff743-41e3-4d48-9537-34b55a64a193 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:41.545Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2b0ff743-41e3-4d48-9537-34b55a64a193 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d1ec490-153c-4550-82f4-624b74963ccd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d1ec490-153c-4550-82f4-624b74963ccd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@89a8f5f 2021-04-14T13:23:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d1ec490-153c-4550-82f4-624b74963ccd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7d1ec490-153c-4550-82f4-624b74963ccd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:23:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:23:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15143f1-6073-49c9-8b9f-e20fb949cfd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15143f1-6073-49c9-8b9f-e20fb949cfd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@50ad4e6c 2021-04-14T13:23:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15143f1-6073-49c9-8b9f-e20fb949cfd9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:47.896Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a15143f1-6073-49c9-8b9f-e20fb949cfd9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:48.231Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=3412a7a1-d726-4d87-b587-9b85bc6b8de8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:23:48.231202Z InvocationID=a5fcb619-91ed-489b-8eda-50e9a3bc52be LogTimestamp=2021-04-14T13:23:48.231222Z Entering 2021-04-14T13:23:48.231Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=3412a7a1-d726-4d87-b587-9b85bc6b8de8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:23:48.231202Z InvocationID=a5fcb619-91ed-489b-8eda-50e9a3bc52be LogTimestamp=2021-04-14T13:23:48.231222Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:23:48.232Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:23:48.231Z InvocationID=e0c51f72-9082-4357-8d53-c971d9560722 LogTimestamp=2021-04-14T13:23:48.232188Z ResponseDesc=OK Exiting. 2021-04-14T13:23:48.232Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4141a5af-64e6-4d1c-8b5a-a71a9f9ab739 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4141a5af-64e6-4d1c-8b5a-a71a9f9ab739 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@759704a9 2021-04-14T13:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4141a5af-64e6-4d1c-8b5a-a71a9f9ab739 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:51.227Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4141a5af-64e6-4d1c-8b5a-a71a9f9ab739 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:53.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29fbf5-447d-4c9d-a0e5-c583dedd6436 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:53.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29fbf5-447d-4c9d-a0e5-c583dedd6436 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@440960eb 2021-04-14T13:23:53.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29fbf5-447d-4c9d-a0e5-c583dedd6436 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:53.756Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5c29fbf5-447d-4c9d-a0e5-c583dedd6436 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:56.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5db23523-8079-48de-b102-e6ed1f9103e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:56.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5db23523-8079-48de-b102-e6ed1f9103e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1835ff42 2021-04-14T13:23:56.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5db23523-8079-48de-b102-e6ed1f9103e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:56.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5db23523-8079-48de-b102-e6ed1f9103e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:23:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41b302cb-ce6e-4b6a-b773-4028404617b0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:23:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41b302cb-ce6e-4b6a-b773-4028404617b0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22d11c06 2021-04-14T13:23:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41b302cb-ce6e-4b6a-b773-4028404617b0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:23:59.524Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41b302cb-ce6e-4b6a-b773-4028404617b0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:03.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e05e2c-eb8f-4a08-a57a-9bb9c139ad11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:03.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e05e2c-eb8f-4a08-a57a-9bb9c139ad11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f2ef6b9 2021-04-14T13:24:03.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e05e2c-eb8f-4a08-a57a-9bb9c139ad11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:03.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e05e2c-eb8f-4a08-a57a-9bb9c139ad11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:24:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:24:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:24:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:24:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:24:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:24:05.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f11a308-d938-4664-8716-0a328e79692a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:05.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f11a308-d938-4664-8716-0a328e79692a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@602fdd8f 2021-04-14T13:24:05.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f11a308-d938-4664-8716-0a328e79692a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:05.883Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2f11a308-d938-4664-8716-0a328e79692a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:06.245Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=64edce6a-e25d-4491-a8dd-df35e3679a73 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:06.244971Z InvocationID=50d35a48-f112-42c3-a7cb-de07345a11c4 LogTimestamp=2021-04-14T13:24:06.245100Z Entering 2021-04-14T13:24:06.246Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=64edce6a-e25d-4491-a8dd-df35e3679a73 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:06.244971Z InvocationID=50d35a48-f112-42c3-a7cb-de07345a11c4 LogTimestamp=2021-04-14T13:24:06.245100Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:24:06.249Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:24:06.246Z InvocationID=b458d2ab-baa5-4aa0-82d3-b7342fc7433b LogTimestamp=2021-04-14T13:24:06.249367Z ResponseDesc=OK Exiting. 2021-04-14T13:24:06.249Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:24:09.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3689c7ea-56ba-454d-8bce-b51bb39cc11c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:09.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3689c7ea-56ba-454d-8bce-b51bb39cc11c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57d7e127 2021-04-14T13:24:09.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3689c7ea-56ba-454d-8bce-b51bb39cc11c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:09.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3689c7ea-56ba-454d-8bce-b51bb39cc11c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e16cae-0787-4f02-92f6-e8adc160784a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e16cae-0787-4f02-92f6-e8adc160784a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7dcce6f7 2021-04-14T13:24:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e16cae-0787-4f02-92f6-e8adc160784a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:11.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0e16cae-0787-4f02-92f6-e8adc160784a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:14.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97675cd-f102-4763-b59d-790b276e435a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:14.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97675cd-f102-4763-b59d-790b276e435a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65cf5cc9 2021-04-14T13:24:14.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97675cd-f102-4763-b59d-790b276e435a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:14.795Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c97675cd-f102-4763-b59d-790b276e435a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd0ee0f-830b-4dea-8e24-d7785441f94b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd0ee0f-830b-4dea-8e24-d7785441f94b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b92365a 2021-04-14T13:24:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd0ee0f-830b-4dea-8e24-d7785441f94b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:17.998Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1cd0ee0f-830b-4dea-8e24-d7785441f94b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff3d39-2e66-49cb-acd2-32c60cc14b29 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff3d39-2e66-49cb-acd2-32c60cc14b29 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13242ed6 2021-04-14T13:24:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff3d39-2e66-49cb-acd2-32c60cc14b29 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:20.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=07ff3d39-2e66-49cb-acd2-32c60cc14b29 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac90d2c-d8f8-4cf2-b0eb-7e9b35623dcd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:24.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac90d2c-d8f8-4cf2-b0eb-7e9b35623dcd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@945991b 2021-04-14T13:24:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac90d2c-d8f8-4cf2-b0eb-7e9b35623dcd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:24.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fac90d2c-d8f8-4cf2-b0eb-7e9b35623dcd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:26.182Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=09780fa8-69b6-486b-a4f3-1367164484c7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:26.182163Z InvocationID=876e2430-0b7e-49cc-98b1-eb1fff3e7bb7 LogTimestamp=2021-04-14T13:24:26.182209Z Entering 2021-04-14T13:24:26.182Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=09780fa8-69b6-486b-a4f3-1367164484c7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:26.182163Z InvocationID=876e2430-0b7e-49cc-98b1-eb1fff3e7bb7 LogTimestamp=2021-04-14T13:24:26.182209Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:24:26.184Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:24:26.182Z InvocationID=487bce47-5a8c-42bf-9140-2ba7f5dadf0a LogTimestamp=2021-04-14T13:24:26.183982Z ResponseDesc=OK Exiting. 2021-04-14T13:24:26.184Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:24:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f0eb3e6-de77-4aef-86af-94874d2e13dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f0eb3e6-de77-4aef-86af-94874d2e13dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1673a5ee 2021-04-14T13:24:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f0eb3e6-de77-4aef-86af-94874d2e13dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:27.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6f0eb3e6-de77-4aef-86af-94874d2e13dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0039e2d-4e6d-488b-b132-bfab884e44e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0039e2d-4e6d-488b-b132-bfab884e44e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c39619c 2021-04-14T13:24:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0039e2d-4e6d-488b-b132-bfab884e44e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:30.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0039e2d-4e6d-488b-b132-bfab884e44e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48bc0ef9-6f9c-4e81-8b92-141e1660e0c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48bc0ef9-6f9c-4e81-8b92-141e1660e0c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ed9a253 2021-04-14T13:24:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48bc0ef9-6f9c-4e81-8b92-141e1660e0c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48bc0ef9-6f9c-4e81-8b92-141e1660e0c5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc249af2-198b-4539-bc0b-07b4d9d1229a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc249af2-198b-4539-bc0b-07b4d9d1229a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6b7177d2 2021-04-14T13:24:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc249af2-198b-4539-bc0b-07b4d9d1229a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:35.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc249af2-198b-4539-bc0b-07b4d9d1229a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:36.223Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ffd76e5d-0e49-4b68-839b-fdb83e7f42b3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:36.223615Z InvocationID=396d653f-3a7e-46c8-a3d3-44a5228a6534 LogTimestamp=2021-04-14T13:24:36.223655Z Entering 2021-04-14T13:24:36.223Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ffd76e5d-0e49-4b68-839b-fdb83e7f42b3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:36.223615Z InvocationID=396d653f-3a7e-46c8-a3d3-44a5228a6534 LogTimestamp=2021-04-14T13:24:36.223655Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:24:36.225Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:24:36.224Z InvocationID=8b3f3d7a-734f-49fc-a3ac-9dc5bb308afc LogTimestamp=2021-04-14T13:24:36.225038Z ResponseDesc=OK Exiting. 2021-04-14T13:24:36.225Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:24:38.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=121c13b2-640e-4097-8914-9a654b260f6e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:38.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=121c13b2-640e-4097-8914-9a654b260f6e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60a6e387 2021-04-14T13:24:38.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=121c13b2-640e-4097-8914-9a654b260f6e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:38.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=121c13b2-640e-4097-8914-9a654b260f6e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7e6d1-b973-4d03-acf1-ca1a1d36eb5e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7e6d1-b973-4d03-acf1-ca1a1d36eb5e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57245b8e 2021-04-14T13:24:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7e6d1-b973-4d03-acf1-ca1a1d36eb5e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ee7e6d1-b973-4d03-acf1-ca1a1d36eb5e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:44.872Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a53175b2-b4fa-40e6-952c-1e9320e9cc4b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:44.872043Z InvocationID=6aef024b-8c82-4425-9cb6-406a1975b64a LogTimestamp=2021-04-14T13:24:44.872095Z Entering 2021-04-14T13:24:44.872Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a53175b2-b4fa-40e6-952c-1e9320e9cc4b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=dcae auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.14 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.14 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:24:44.872043Z InvocationID=6aef024b-8c82-4425-9cb6-406a1975b64a LogTimestamp=2021-04-14T13:24:44.872095Z localAddr=10.242.62.146 remoteAddr=10.242.5.14 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:24:44.873Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.6) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:24:44.872Z InvocationID=22416db1-5582-400f-b887-333d9973079d LogTimestamp=2021-04-14T13:24:44.873359Z ResponseDesc=OK Exiting. 2021-04-14T13:24:44.873Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:24:45.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b9cc74-0ae2-4add-a318-2020a7fbd12b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:45.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b9cc74-0ae2-4add-a318-2020a7fbd12b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54ecb003 2021-04-14T13:24:45.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b9cc74-0ae2-4add-a318-2020a7fbd12b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:45.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16b9cc74-0ae2-4add-a318-2020a7fbd12b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:24:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:24:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b3fb03a-d9a1-4db7-bc4f-ca3a4d4f1ce0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b3fb03a-d9a1-4db7-bc4f-ca3a4d4f1ce0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@344382ab 2021-04-14T13:24:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b3fb03a-d9a1-4db7-bc4f-ca3a4d4f1ce0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:47.907Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b3fb03a-d9a1-4db7-bc4f-ca3a4d4f1ce0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757a59b6-0126-4915-be60-7ced38e69504 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757a59b6-0126-4915-be60-7ced38e69504 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63aef57f 2021-04-14T13:24:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757a59b6-0126-4915-be60-7ced38e69504 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:51.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=757a59b6-0126-4915-be60-7ced38e69504 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:54.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98179786-faf7-4a42-a61e-ae1dceb00ebf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:54.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98179786-faf7-4a42-a61e-ae1dceb00ebf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16a33aaf 2021-04-14T13:24:54.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98179786-faf7-4a42-a61e-ae1dceb00ebf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:54.034Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98179786-faf7-4a42-a61e-ae1dceb00ebf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082e348-1b88-490d-b3b3-81f4cb3b15d9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082e348-1b88-490d-b3b3-81f4cb3b15d9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@277efcd0 2021-04-14T13:24:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082e348-1b88-490d-b3b3-81f4cb3b15d9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:56.945Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d082e348-1b88-490d-b3b3-81f4cb3b15d9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:24:59.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b52e772-3ef3-473e-84c6-049933f81b48 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:24:59.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b52e772-3ef3-473e-84c6-049933f81b48 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@f80644e 2021-04-14T13:24:59.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b52e772-3ef3-473e-84c6-049933f81b48 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:24:59.752Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7b52e772-3ef3-473e-84c6-049933f81b48 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:02.810Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf149f-8276-4fe3-9932-a82d09127304 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:02.810Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf149f-8276-4fe3-9932-a82d09127304 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b116dcc 2021-04-14T13:25:02.810Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf149f-8276-4fe3-9932-a82d09127304 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:02.810Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d8cf149f-8276-4fe3-9932-a82d09127304 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:25:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:25:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:25:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:25:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:25:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:25:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7f64226-bd53-4a48-8d46-e1fbffbc18e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7f64226-bd53-4a48-8d46-e1fbffbc18e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14684a43 2021-04-14T13:25:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7f64226-bd53-4a48-8d46-e1fbffbc18e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7f64226-bd53-4a48-8d46-e1fbffbc18e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:06.239Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ddd8bc77-994f-4281-8ac7-0f3f654f7596 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:06.239897Z InvocationID=a583fea6-c050-49e1-b774-abb6b007eb0f LogTimestamp=2021-04-14T13:25:06.239918Z Entering 2021-04-14T13:25:06.240Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ddd8bc77-994f-4281-8ac7-0f3f654f7596 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:06.239897Z InvocationID=a583fea6-c050-49e1-b774-abb6b007eb0f LogTimestamp=2021-04-14T13:25:06.239918Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:25:06.241Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:25:06.240Z InvocationID=9a5c44b0-bc6c-4075-9c9a-f4a5390ace79 LogTimestamp=2021-04-14T13:25:06.240995Z ResponseDesc=OK Exiting. 2021-04-14T13:25:06.241Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:25:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4faa45f9-c3ac-4c3a-98ba-cf497de6bd12 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4faa45f9-c3ac-4c3a-98ba-cf497de6bd12 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44a0bc62 2021-04-14T13:25:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4faa45f9-c3ac-4c3a-98ba-cf497de6bd12 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4faa45f9-c3ac-4c3a-98ba-cf497de6bd12 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9642832-b9b7-44d3-b4d0-07cc682fbec8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9642832-b9b7-44d3-b4d0-07cc682fbec8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@480e12ac 2021-04-14T13:25:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9642832-b9b7-44d3-b4d0-07cc682fbec8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:12.027Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c9642832-b9b7-44d3-b4d0-07cc682fbec8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:14.782Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3e7f98-e1c5-4e98-a101-62ced31a31a9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3e7f98-e1c5-4e98-a101-62ced31a31a9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5861796c 2021-04-14T13:25:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3e7f98-e1c5-4e98-a101-62ced31a31a9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e3e7f98-e1c5-4e98-a101-62ced31a31a9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:15.151Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0b899407-c2c0-4263-99af-9aac94f36a81 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:15.151650Z InvocationID=a2b5ebe5-13ae-4086-b973-f3922ca5eba2 LogTimestamp=2021-04-14T13:25:15.151675Z Entering 2021-04-14T13:25:15.151Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0b899407-c2c0-4263-99af-9aac94f36a81 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:15.151650Z InvocationID=a2b5ebe5-13ae-4086-b973-f3922ca5eba2 LogTimestamp=2021-04-14T13:25:15.151675Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:25:15.153Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:25:15.152Z InvocationID=5ce7a2ea-e171-4bf3-be67-c0dc389d10d2 LogTimestamp=2021-04-14T13:25:15.152964Z ResponseDesc=OK Exiting. 2021-04-14T13:25:15.153Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:25:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:18.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8393aff8-6e70-4cdf-9d77-1c764853fdcb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:18.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8393aff8-6e70-4cdf-9d77-1c764853fdcb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e8d0a71 2021-04-14T13:25:18.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8393aff8-6e70-4cdf-9d77-1c764853fdcb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:18.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8393aff8-6e70-4cdf-9d77-1c764853fdcb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed077ae4-c860-478a-9144-5d7eb6e3a2f2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed077ae4-c860-478a-9144-5d7eb6e3a2f2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f0fe46e 2021-04-14T13:25:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed077ae4-c860-478a-9144-5d7eb6e3a2f2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:20.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ed077ae4-c860-478a-9144-5d7eb6e3a2f2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:24.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d8856d7-e244-43ae-913e-57a8137366cc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:24.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d8856d7-e244-43ae-913e-57a8137366cc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@772c1451 2021-04-14T13:25:24.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d8856d7-e244-43ae-913e-57a8137366cc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:24.036Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d8856d7-e244-43ae-913e-57a8137366cc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f80d87d4-7cf5-4b56-993e-10520240dca8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f80d87d4-7cf5-4b56-993e-10520240dca8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2455a9c1 2021-04-14T13:25:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f80d87d4-7cf5-4b56-993e-10520240dca8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:27.096Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f80d87d4-7cf5-4b56-993e-10520240dca8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:30.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb7054e-1090-4634-ba1c-13479405b6c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:30.214Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb7054e-1090-4634-ba1c-13479405b6c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42ede1b8 2021-04-14T13:25:30.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb7054e-1090-4634-ba1c-13479405b6c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:30.215Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dcb7054e-1090-4634-ba1c-13479405b6c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:33.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b1851f-6fed-480f-8bee-a427e7075ac5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:33.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b1851f-6fed-480f-8bee-a427e7075ac5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7271411f 2021-04-14T13:25:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b1851f-6fed-480f-8bee-a427e7075ac5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:33.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6b1851f-6fed-480f-8bee-a427e7075ac5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:35.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e84d5548-e811-48fd-8077-e9d5e53772b6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:35.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e84d5548-e811-48fd-8077-e9d5e53772b6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65e85d9c 2021-04-14T13:25:35.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e84d5548-e811-48fd-8077-e9d5e53772b6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:35.806Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e84d5548-e811-48fd-8077-e9d5e53772b6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:36.232Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a5749a97-3b59-4975-8956-e75051d45c70 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:36.231916Z InvocationID=eb9b1a05-367e-4d1d-bf57-d661cc80da2b LogTimestamp=2021-04-14T13:25:36.232006Z Entering 2021-04-14T13:25:36.232Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a5749a97-3b59-4975-8956-e75051d45c70 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:36.231916Z InvocationID=eb9b1a05-367e-4d1d-bf57-d661cc80da2b LogTimestamp=2021-04-14T13:25:36.232006Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:25:36.234Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:25:36.232Z InvocationID=b9b6c1d1-982d-496d-b8e4-f3c183db4bac LogTimestamp=2021-04-14T13:25:36.234477Z ResponseDesc=OK Exiting. 2021-04-14T13:25:36.234Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:25:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46077532-6275-4406-8550-ef09e20e6940 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46077532-6275-4406-8550-ef09e20e6940 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cfaeb41 2021-04-14T13:25:38.837Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46077532-6275-4406-8550-ef09e20e6940 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:38.838Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=46077532-6275-4406-8550-ef09e20e6940 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb9820b2-f57b-4583-9d13-c7aeff747405 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb9820b2-f57b-4583-9d13-c7aeff747405 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41b72747 2021-04-14T13:25:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb9820b2-f57b-4583-9d13-c7aeff747405 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:41.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb9820b2-f57b-4583-9d13-c7aeff747405 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:45.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefc2b2-41f8-43a1-bfb7-4193fd5d5647 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:45.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefc2b2-41f8-43a1-bfb7-4193fd5d5647 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3936ffd7 2021-04-14T13:25:45.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefc2b2-41f8-43a1-bfb7-4193fd5d5647 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:45.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faefc2b2-41f8-43a1-bfb7-4193fd5d5647 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:25:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:25:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6afe8669-8294-464f-8e7e-0bfae96b797c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6afe8669-8294-464f-8e7e-0bfae96b797c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e1541d0 2021-04-14T13:25:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6afe8669-8294-464f-8e7e-0bfae96b797c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:47.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6afe8669-8294-464f-8e7e-0bfae96b797c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:48.210Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f5538cd7-a384-4c73-bde6-9bb5da29dc11 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:48.210041Z InvocationID=7b567113-fb55-4ba7-85c2-1885dd85cad5 LogTimestamp=2021-04-14T13:25:48.210076Z Entering 2021-04-14T13:25:48.210Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f5538cd7-a384-4c73-bde6-9bb5da29dc11 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:25:48.210041Z InvocationID=7b567113-fb55-4ba7-85c2-1885dd85cad5 LogTimestamp=2021-04-14T13:25:48.210076Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:25:48.211Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:25:48.210Z InvocationID=06a0e303-a109-431a-a8ae-70e5ecf5b668 LogTimestamp=2021-04-14T13:25:48.211404Z ResponseDesc=OK Exiting. 2021-04-14T13:25:48.211Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:25:51.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66b94640-605b-408a-afae-118a7b485afe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:51.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66b94640-605b-408a-afae-118a7b485afe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@250e01b0 2021-04-14T13:25:51.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66b94640-605b-408a-afae-118a7b485afe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:51.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=66b94640-605b-408a-afae-118a7b485afe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:53.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6673d480-fd03-4825-983c-a2ce9f0e9ceb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:53.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6673d480-fd03-4825-983c-a2ce9f0e9ceb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5dfb8749 2021-04-14T13:25:53.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6673d480-fd03-4825-983c-a2ce9f0e9ceb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:53.748Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6673d480-fd03-4825-983c-a2ce9f0e9ceb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6811cc-278b-4343-9d2b-59206862cb7b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6811cc-278b-4343-9d2b-59206862cb7b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53bd1366 2021-04-14T13:25:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6811cc-278b-4343-9d2b-59206862cb7b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c6811cc-278b-4343-9d2b-59206862cb7b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:25:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ce8166-8d70-4d86-bb51-c7841da31ab7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:25:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ce8166-8d70-4d86-bb51-c7841da31ab7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6712c300 2021-04-14T13:25:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ce8166-8d70-4d86-bb51-c7841da31ab7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:25:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a1ce8166-8d70-4d86-bb51-c7841da31ab7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:02.729Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b03764f0-7abb-4036-9bf9-e0d0d2899936 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:02.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b03764f0-7abb-4036-9bf9-e0d0d2899936 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32c45dd3 2021-04-14T13:26:02.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b03764f0-7abb-4036-9bf9-e0d0d2899936 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:02.730Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b03764f0-7abb-4036-9bf9-e0d0d2899936 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:26:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:26:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:26:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:26:04.354Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:26:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:26:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cbb45d2-7926-4dbf-ab2b-9dcd14b3ba9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cbb45d2-7926-4dbf-ab2b-9dcd14b3ba9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3304550d 2021-04-14T13:26:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cbb45d2-7926-4dbf-ab2b-9dcd14b3ba9b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:06.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5cbb45d2-7926-4dbf-ab2b-9dcd14b3ba9b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:06.222Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1b9966bd-c428-4ef3-81ce-c345559cbfe5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:26:06.222322Z InvocationID=dd50d70a-65ca-4d75-a600-5e3976e06e7a LogTimestamp=2021-04-14T13:26:06.222351Z Entering 2021-04-14T13:26:06.222Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1b9966bd-c428-4ef3-81ce-c345559cbfe5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:26:06.222322Z InvocationID=dd50d70a-65ca-4d75-a600-5e3976e06e7a LogTimestamp=2021-04-14T13:26:06.222351Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:26:06.223Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:26:06.222Z InvocationID=3414c21c-3d53-4d7f-9ea3-c3d83182177e LogTimestamp=2021-04-14T13:26:06.223766Z ResponseDesc=OK Exiting. 2021-04-14T13:26:06.223Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:26:09.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db208325-1417-42a1-8f32-72f19f347ae1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:09.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db208325-1417-42a1-8f32-72f19f347ae1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@8995628 2021-04-14T13:26:09.187Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db208325-1417-42a1-8f32-72f19f347ae1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:09.188Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db208325-1417-42a1-8f32-72f19f347ae1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:11.936Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c86e3fb-13cb-4319-8fed-daf5dd8b682a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c86e3fb-13cb-4319-8fed-daf5dd8b682a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79e28ef8 2021-04-14T13:26:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c86e3fb-13cb-4319-8fed-daf5dd8b682a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:11.937Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c86e3fb-13cb-4319-8fed-daf5dd8b682a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7329cbb-76eb-4f1f-bf98-64b93db704e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7329cbb-76eb-4f1f-bf98-64b93db704e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@69d87ed2 2021-04-14T13:26:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7329cbb-76eb-4f1f-bf98-64b93db704e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7329cbb-76eb-4f1f-bf98-64b93db704e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:18.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f95f73c-be29-448f-b85a-9bbfd689fdaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:18.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f95f73c-be29-448f-b85a-9bbfd689fdaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7865f2d9 2021-04-14T13:26:18.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f95f73c-be29-448f-b85a-9bbfd689fdaf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:18.104Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5f95f73c-be29-448f-b85a-9bbfd689fdaf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:20.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f64de0ce-48d6-4988-99fe-f9fd57ccb306 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:20.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f64de0ce-48d6-4988-99fe-f9fd57ccb306 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a0fd3eb 2021-04-14T13:26:20.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f64de0ce-48d6-4988-99fe-f9fd57ccb306 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:20.611Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f64de0ce-48d6-4988-99fe-f9fd57ccb306 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=608c3f78-ad7f-4d20-a460-e84107fc5101 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=608c3f78-ad7f-4d20-a460-e84107fc5101 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@57771f1c 2021-04-14T13:26:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=608c3f78-ad7f-4d20-a460-e84107fc5101 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=608c3f78-ad7f-4d20-a460-e84107fc5101 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b474d-62a6-43d3-bd16-57ea3ab5b0b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b474d-62a6-43d3-bd16-57ea3ab5b0b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d73d5ce 2021-04-14T13:26:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b474d-62a6-43d3-bd16-57ea3ab5b0b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:27.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=423b474d-62a6-43d3-bd16-57ea3ab5b0b1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a4ffd6-f1fd-4cac-a71e-d8a59791d1d1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a4ffd6-f1fd-4cac-a71e-d8a59791d1d1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a571383 2021-04-14T13:26:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a4ffd6-f1fd-4cac-a71e-d8a59791d1d1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:30.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=40a4ffd6-f1fd-4cac-a71e-d8a59791d1d1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:33.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=564f6e82-012b-453f-8346-465dfe159067 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:33.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=564f6e82-012b-453f-8346-465dfe159067 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6e031da9 2021-04-14T13:26:33.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=564f6e82-012b-453f-8346-465dfe159067 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:33.332Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=564f6e82-012b-453f-8346-465dfe159067 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:35.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ccebb0-84a6-4af9-b7d6-a5dda0e0fef2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:35.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ccebb0-84a6-4af9-b7d6-a5dda0e0fef2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@163608a 2021-04-14T13:26:35.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ccebb0-84a6-4af9-b7d6-a5dda0e0fef2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:35.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e0ccebb0-84a6-4af9-b7d6-a5dda0e0fef2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:36.243Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b052aa24-59bb-4987-a4c8-2bce4276ebd3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:26:36.243502Z InvocationID=c27f18f4-521e-417e-a3f0-b8e7bd31a114 LogTimestamp=2021-04-14T13:26:36.243538Z Entering 2021-04-14T13:26:36.243Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b052aa24-59bb-4987-a4c8-2bce4276ebd3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:26:36.243502Z InvocationID=c27f18f4-521e-417e-a3f0-b8e7bd31a114 LogTimestamp=2021-04-14T13:26:36.243538Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:26:36.245Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:26:36.244Z InvocationID=0f93df5b-3938-4e83-b7ea-425effad855d LogTimestamp=2021-04-14T13:26:36.244949Z ResponseDesc=OK Exiting. 2021-04-14T13:26:36.245Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:26:39.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc64cafc-8829-496e-a962-11321d5b2ae8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:39.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc64cafc-8829-496e-a962-11321d5b2ae8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@625d08cd 2021-04-14T13:26:39.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc64cafc-8829-496e-a962-11321d5b2ae8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:39.035Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cc64cafc-8829-496e-a962-11321d5b2ae8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:41.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb92f028-78e9-40bc-a6ba-ce7c89c03a52 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:41.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb92f028-78e9-40bc-a6ba-ce7c89c03a52 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7084c40e 2021-04-14T13:26:41.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb92f028-78e9-40bc-a6ba-ce7c89c03a52 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:41.557Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=eb92f028-78e9-40bc-a6ba-ce7c89c03a52 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ef18644-0343-4cbe-a3d2-725ea200832b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ef18644-0343-4cbe-a3d2-725ea200832b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61c71e2 2021-04-14T13:26:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ef18644-0343-4cbe-a3d2-725ea200832b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3ef18644-0343-4cbe-a3d2-725ea200832b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:26:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:26:47.881Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ee881-4015-47ac-84b0-d56e4a9cafc5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ee881-4015-47ac-84b0-d56e4a9cafc5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ce1269b 2021-04-14T13:26:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ee881-4015-47ac-84b0-d56e4a9cafc5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:47.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3e4ee881-4015-47ac-84b0-d56e4a9cafc5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61986fc0-e2d8-45c6-b850-854d8a406f6c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61986fc0-e2d8-45c6-b850-854d8a406f6c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@16704eaa 2021-04-14T13:26:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61986fc0-e2d8-45c6-b850-854d8a406f6c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=61986fc0-e2d8-45c6-b850-854d8a406f6c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d61d26-d73a-4828-aa72-022fb2971b3e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:53.850Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d61d26-d73a-4828-aa72-022fb2971b3e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40825cde 2021-04-14T13:26:53.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d61d26-d73a-4828-aa72-022fb2971b3e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:53.851Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a7d61d26-d73a-4828-aa72-022fb2971b3e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75308a78-8c4e-4bf2-93ef-cba2dbc63cdf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75308a78-8c4e-4bf2-93ef-cba2dbc63cdf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@25f4a64d 2021-04-14T13:26:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75308a78-8c4e-4bf2-93ef-cba2dbc63cdf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:56.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=75308a78-8c4e-4bf2-93ef-cba2dbc63cdf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f27e0f-39fb-48d2-b4b0-e814a465912d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f27e0f-39fb-48d2-b4b0-e814a465912d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30b49996 2021-04-14T13:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f27e0f-39fb-48d2-b4b0-e814a465912d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:26:59.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a3f27e0f-39fb-48d2-b4b0-e814a465912d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:01.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:01.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ff653f-6e64-49ca-a4e6-c28a469967c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ff653f-6e64-49ca-a4e6-c28a469967c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24258434 2021-04-14T13:27:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ff653f-6e64-49ca-a4e6-c28a469967c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:03.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34ff653f-6e64-49ca-a4e6-c28a469967c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:27:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:27:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:27:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:27:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:27:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:27:06.221Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=50fc1002-d03e-41d2-b39b-f97c08d4c81a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:06.220979Z InvocationID=80d4307a-5cd4-4d93-90a7-46639120b679 LogTimestamp=2021-04-14T13:27:06.221071Z Entering 2021-04-14T13:27:06.221Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=50fc1002-d03e-41d2-b39b-f97c08d4c81a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:06.220979Z InvocationID=80d4307a-5cd4-4d93-90a7-46639120b679 LogTimestamp=2021-04-14T13:27:06.221071Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:27:06.223Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:27:06.221Z InvocationID=a61fa831-0f25-4093-be8c-eb148287a004 LogTimestamp=2021-04-14T13:27:06.223661Z ResponseDesc=OK Exiting. 2021-04-14T13:27:06.223Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:27:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7df075e-c596-49f9-a071-93b99aab62e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7df075e-c596-49f9-a071-93b99aab62e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@761358c2 2021-04-14T13:27:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7df075e-c596-49f9-a071-93b99aab62e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:06.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7df075e-c596-49f9-a071-93b99aab62e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:08.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d116f4a-37ca-4538-bcd1-1d7ffff65335 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:08.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d116f4a-37ca-4538-bcd1-1d7ffff65335 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@76d54e83 2021-04-14T13:27:08.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d116f4a-37ca-4538-bcd1-1d7ffff65335 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:08.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d116f4a-37ca-4538-bcd1-1d7ffff65335 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:11.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b439b-bb75-42cd-8d1d-3953f743d99b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:11.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b439b-bb75-42cd-8d1d-3953f743d99b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@623901e6 2021-04-14T13:27:11.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b439b-bb75-42cd-8d1d-3953f743d99b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:11.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e5b439b-bb75-42cd-8d1d-3953f743d99b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:14.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0101f54-fc88-43d4-b21a-b69bf2773fa2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:14.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0101f54-fc88-43d4-b21a-b69bf2773fa2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ab52db1 2021-04-14T13:27:14.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0101f54-fc88-43d4-b21a-b69bf2773fa2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:14.794Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0101f54-fc88-43d4-b21a-b69bf2773fa2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:17.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d71842-8803-42f8-9f02-6432a0663216 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:17.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d71842-8803-42f8-9f02-6432a0663216 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@60cad6d 2021-04-14T13:27:17.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d71842-8803-42f8-9f02-6432a0663216 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:17.904Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4d71842-8803-42f8-9f02-6432a0663216 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e556f80-a485-43f0-9321-af932cc22dd0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e556f80-a485-43f0-9321-af932cc22dd0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5af14a79 2021-04-14T13:27:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e556f80-a485-43f0-9321-af932cc22dd0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:20.551Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8e556f80-a485-43f0-9321-af932cc22dd0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f21aa6b-63e6-4f3f-8d5b-1452099b2f02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f21aa6b-63e6-4f3f-8d5b-1452099b2f02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@706d56f0 2021-04-14T13:27:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f21aa6b-63e6-4f3f-8d5b-1452099b2f02 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7f21aa6b-63e6-4f3f-8d5b-1452099b2f02 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=895067a8-3165-40e2-9f9f-7defb8de2216 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=895067a8-3165-40e2-9f9f-7defb8de2216 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33f625e9 2021-04-14T13:27:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=895067a8-3165-40e2-9f9f-7defb8de2216 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=895067a8-3165-40e2-9f9f-7defb8de2216 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:29.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aad937c-01bf-48a3-af7e-157e55cddcdc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:29.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aad937c-01bf-48a3-af7e-157e55cddcdc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5072813f 2021-04-14T13:27:29.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aad937c-01bf-48a3-af7e-157e55cddcdc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:29.916Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6aad937c-01bf-48a3-af7e-157e55cddcdc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b13689-6f82-4eda-95ef-fb41387853dd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b13689-6f82-4eda-95ef-fb41387853dd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@80bbca 2021-04-14T13:27:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b13689-6f82-4eda-95ef-fb41387853dd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:33.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c4b13689-6f82-4eda-95ef-fb41387853dd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:36.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc3e8a9-f24d-4902-ba43-ccbf0ea70d2b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:36.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc3e8a9-f24d-4902-ba43-ccbf0ea70d2b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1a40a7fc 2021-04-14T13:27:36.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc3e8a9-f24d-4902-ba43-ccbf0ea70d2b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:36.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc3e8a9-f24d-4902-ba43-ccbf0ea70d2b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:36.348Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=0df3d520-6c9b-4623-abce-3c5d9346949d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:36.347811Z InvocationID=2f58756b-6dc1-47e3-9b95-05f11555d381 LogTimestamp=2021-04-14T13:27:36.347893Z Entering 2021-04-14T13:27:36.348Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=0df3d520-6c9b-4623-abce-3c5d9346949d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:36.347811Z InvocationID=2f58756b-6dc1-47e3-9b95-05f11555d381 LogTimestamp=2021-04-14T13:27:36.347893Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:27:36.350Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:27:36.348Z InvocationID=fbb2cdb9-4b64-4be8-8329-8e82c07951d1 LogTimestamp=2021-04-14T13:27:36.350301Z ResponseDesc=OK Exiting. 2021-04-14T13:27:36.350Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:27:39.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f3d8295-c280-44da-9d04-c6027af8d80b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:39.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f3d8295-c280-44da-9d04-c6027af8d80b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@181b0030 2021-04-14T13:27:39.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f3d8295-c280-44da-9d04-c6027af8d80b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:39.195Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1f3d8295-c280-44da-9d04-c6027af8d80b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1f0b737-4e2a-4bfc-9b6e-2a20b61e9d80 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1f0b737-4e2a-4bfc-9b6e-2a20b61e9d80 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c240175 2021-04-14T13:27:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1f0b737-4e2a-4bfc-9b6e-2a20b61e9d80 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:41.559Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d1f0b737-4e2a-4bfc-9b6e-2a20b61e9d80 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c109fe1-22a8-498e-bcf3-d96450174e81 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c109fe1-22a8-498e-bcf3-d96450174e81 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@59ffbfd0 2021-04-14T13:27:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c109fe1-22a8-498e-bcf3-d96450174e81 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:45.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8c109fe1-22a8-498e-bcf3-d96450174e81 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:27:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:27:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=475a62b7-9515-4541-833f-740b47c435ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=475a62b7-9515-4541-833f-740b47c435ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@461f9c54 2021-04-14T13:27:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=475a62b7-9515-4541-833f-740b47c435ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:47.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=475a62b7-9515-4541-833f-740b47c435ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:48.223Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=434467b8-1142-4217-a24c-e6b4a45b908c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:48.222969Z InvocationID=2c93c1af-1111-41f9-98d0-afb0775bbe84 LogTimestamp=2021-04-14T13:27:48.223016Z Entering 2021-04-14T13:27:48.223Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=434467b8-1142-4217-a24c-e6b4a45b908c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:48.222969Z InvocationID=2c93c1af-1111-41f9-98d0-afb0775bbe84 LogTimestamp=2021-04-14T13:27:48.223016Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:27:48.224Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:27:48.223Z InvocationID=b53983f4-977f-42dd-8fde-7510338e60fc LogTimestamp=2021-04-14T13:27:48.224211Z ResponseDesc=OK Exiting. 2021-04-14T13:27:48.224Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:27:49.665Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b0980d57-9126-4e4c-9c62-7be6824fa6d5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:49.665472Z InvocationID=87bd7f40-20b5-446c-8eb3-de11e647c3d1 LogTimestamp=2021-04-14T13:27:49.665510Z Entering 2021-04-14T13:27:49.665Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b0980d57-9126-4e4c-9c62-7be6824fa6d5 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:27:49.665472Z InvocationID=87bd7f40-20b5-446c-8eb3-de11e647c3d1 LogTimestamp=2021-04-14T13:27:49.665510Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:27:49.666Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:27:49.665Z InvocationID=89edb2d0-caed-43b7-a104-7953fc6049b9 LogTimestamp=2021-04-14T13:27:49.666505Z ResponseDesc=OK Exiting. 2021-04-14T13:27:49.666Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:27:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2342ed2a-d95a-410e-abf4-1897740a9361 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2342ed2a-d95a-410e-abf4-1897740a9361 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c50e27 2021-04-14T13:27:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2342ed2a-d95a-410e-abf4-1897740a9361 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:51.315Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2342ed2a-d95a-410e-abf4-1897740a9361 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d40abbd8-679d-49ea-889b-43ec5cc6d109 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d40abbd8-679d-49ea-889b-43ec5cc6d109 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a969823 2021-04-14T13:27:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d40abbd8-679d-49ea-889b-43ec5cc6d109 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:53.852Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d40abbd8-679d-49ea-889b-43ec5cc6d109 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:56.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33553186-21cf-4d6f-8055-143cd01a1301 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:56.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33553186-21cf-4d6f-8055-143cd01a1301 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5eb3b99e 2021-04-14T13:27:56.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33553186-21cf-4d6f-8055-143cd01a1301 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:56.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33553186-21cf-4d6f-8055-143cd01a1301 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:27:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18d7d299-1e91-4abb-a6a9-e8b7e41b1a46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:27:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18d7d299-1e91-4abb-a6a9-e8b7e41b1a46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64f46320 2021-04-14T13:27:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18d7d299-1e91-4abb-a6a9-e8b7e41b1a46 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:27:59.540Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18d7d299-1e91-4abb-a6a9-e8b7e41b1a46 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:03.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b88eba5a-6b5b-467e-9e53-b22370a2a05f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:03.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b88eba5a-6b5b-467e-9e53-b22370a2a05f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4aeeedaf 2021-04-14T13:28:03.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b88eba5a-6b5b-467e-9e53-b22370a2a05f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:03.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b88eba5a-6b5b-467e-9e53-b22370a2a05f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:28:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:28:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:28:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:28:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:28:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:28:06.228Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9dac974d-e935-4bb3-a6d3-d76a803b6900 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:28:06.228053Z InvocationID=60e7eb59-f8bc-4e69-9c66-6834c1db2947 LogTimestamp=2021-04-14T13:28:06.228091Z Entering 2021-04-14T13:28:06.228Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9dac974d-e935-4bb3-a6d3-d76a803b6900 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:28:06.228053Z InvocationID=60e7eb59-f8bc-4e69-9c66-6834c1db2947 LogTimestamp=2021-04-14T13:28:06.228091Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:28:06.229Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:28:06.228Z InvocationID=f8d91237-47bd-41a3-884b-2676e3bc71cb LogTimestamp=2021-04-14T13:28:06.229940Z ResponseDesc=OK Exiting. 2021-04-14T13:28:06.230Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:28:06.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec973508-3b4c-4677-ae12-8274db833fa3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:06.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec973508-3b4c-4677-ae12-8274db833fa3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f72351 2021-04-14T13:28:06.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec973508-3b4c-4677-ae12-8274db833fa3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:06.412Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ec973508-3b4c-4677-ae12-8274db833fa3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:08.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0690537d-54e8-4f42-8a6e-7802b3a40418 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:08.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0690537d-54e8-4f42-8a6e-7802b3a40418 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47cb0518 2021-04-14T13:28:08.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0690537d-54e8-4f42-8a6e-7802b3a40418 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:08.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0690537d-54e8-4f42-8a6e-7802b3a40418 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fae5bec-de2a-40db-830b-ad8682bb3728 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fae5bec-de2a-40db-830b-ad8682bb3728 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@e193a2 2021-04-14T13:28:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fae5bec-de2a-40db-830b-ad8682bb3728 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:12.022Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0fae5bec-de2a-40db-830b-ad8682bb3728 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05dc426a-e43d-457e-a147-4a829aa6f8c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05dc426a-e43d-457e-a147-4a829aa6f8c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ddf8584 2021-04-14T13:28:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05dc426a-e43d-457e-a147-4a829aa6f8c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:14.783Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=05dc426a-e43d-457e-a147-4a829aa6f8c0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:16.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:18.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c2e01db-7ccb-4466-bb5b-58c95e0fd472 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:18.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c2e01db-7ccb-4466-bb5b-58c95e0fd472 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@fd4c5 2021-04-14T13:28:18.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c2e01db-7ccb-4466-bb5b-58c95e0fd472 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:18.193Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c2e01db-7ccb-4466-bb5b-58c95e0fd472 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb49cae5-2e50-40c8-820c-33af5d65e72b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb49cae5-2e50-40c8-820c-33af5d65e72b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f73e219 2021-04-14T13:28:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb49cae5-2e50-40c8-820c-33af5d65e72b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:20.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bb49cae5-2e50-40c8-820c-33af5d65e72b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:24.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c175a1d7-aa0d-41ca-9f62-835e9e9dbff6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:24.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c175a1d7-aa0d-41ca-9f62-835e9e9dbff6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13031ed6 2021-04-14T13:28:24.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c175a1d7-aa0d-41ca-9f62-835e9e9dbff6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:24.129Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c175a1d7-aa0d-41ca-9f62-835e9e9dbff6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fdc4a5c-261b-46b6-8113-5b6aba71e127 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fdc4a5c-261b-46b6-8113-5b6aba71e127 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52b14a97 2021-04-14T13:28:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fdc4a5c-261b-46b6-8113-5b6aba71e127 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9fdc4a5c-261b-46b6-8113-5b6aba71e127 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:29.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9831cc42-9f94-40d4-99c1-a96f91930ec4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:29.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9831cc42-9f94-40d4-99c1-a96f91930ec4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ce615f8 2021-04-14T13:28:29.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9831cc42-9f94-40d4-99c1-a96f91930ec4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:29.816Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9831cc42-9f94-40d4-99c1-a96f91930ec4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=252819bb-1395-48bd-9034-9966f060e437 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=252819bb-1395-48bd-9034-9966f060e437 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c054957 2021-04-14T13:28:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=252819bb-1395-48bd-9034-9966f060e437 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:33.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=252819bb-1395-48bd-9034-9966f060e437 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8914d2-7144-46bb-96d1-be480f3624b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8914d2-7144-46bb-96d1-be480f3624b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27fb17af 2021-04-14T13:28:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8914d2-7144-46bb-96d1-be480f3624b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:36.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3c8914d2-7144-46bb-96d1-be480f3624b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:36.236Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=994e6957-28c6-4c34-bb1b-1f4a407a65f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:28:36.235979Z InvocationID=b2b22e3f-d413-49ae-8c65-04612eec61eb LogTimestamp=2021-04-14T13:28:36.236035Z Entering 2021-04-14T13:28:36.236Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=994e6957-28c6-4c34-bb1b-1f4a407a65f7 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:28:36.235979Z InvocationID=b2b22e3f-d413-49ae-8c65-04612eec61eb LogTimestamp=2021-04-14T13:28:36.236035Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:28:36.238Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:28:36.236Z InvocationID=a4034742-327a-4da2-a496-c6f349522192 LogTimestamp=2021-04-14T13:28:36.238484Z ResponseDesc=OK Exiting. 2021-04-14T13:28:36.238Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:28:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e9f2e-3030-4004-be5e-43395c23dd9c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e9f2e-3030-4004-be5e-43395c23dd9c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7fc60435 2021-04-14T13:28:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e9f2e-3030-4004-be5e-43395c23dd9c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:38.941Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=852e9f2e-3030-4004-be5e-43395c23dd9c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfa721b1-6ba0-4374-b89c-6c674213e55f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfa721b1-6ba0-4374-b89c-6c674213e55f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@631387e0 2021-04-14T13:28:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfa721b1-6ba0-4374-b89c-6c674213e55f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:41.560Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfa721b1-6ba0-4374-b89c-6c674213e55f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d57f7f5-115e-4e67-aeb2-592f05348df2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d57f7f5-115e-4e67-aeb2-592f05348df2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@655a3524 2021-04-14T13:28:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d57f7f5-115e-4e67-aeb2-592f05348df2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:45.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9d57f7f5-115e-4e67-aeb2-592f05348df2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:28:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:28:47.784Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db25f01-3b0c-44a3-a15d-479cc5079f4b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:47.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db25f01-3b0c-44a3-a15d-479cc5079f4b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ae3104f 2021-04-14T13:28:47.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db25f01-3b0c-44a3-a15d-479cc5079f4b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:47.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4db25f01-3b0c-44a3-a15d-479cc5079f4b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=900ee2b2-f9ed-46b0-80e7-80f1594ef449 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=900ee2b2-f9ed-46b0-80e7-80f1594ef449 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55cb488a 2021-04-14T13:28:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=900ee2b2-f9ed-46b0-80e7-80f1594ef449 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=900ee2b2-f9ed-46b0-80e7-80f1594ef449 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7085c73a-8253-4842-9e1a-0afb503827e9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7085c73a-8253-4842-9e1a-0afb503827e9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a18e954 2021-04-14T13:28:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7085c73a-8253-4842-9e1a-0afb503827e9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:53.865Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7085c73a-8253-4842-9e1a-0afb503827e9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:56.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017785cc-2fa6-48d9-abe3-04e5174d5c85 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:56.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017785cc-2fa6-48d9-abe3-04e5174d5c85 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e5f1a26 2021-04-14T13:28:56.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017785cc-2fa6-48d9-abe3-04e5174d5c85 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:56.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=017785cc-2fa6-48d9-abe3-04e5174d5c85 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:28:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d3ba3b4-4f47-4d9f-ba72-eabe770ffc30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:28:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d3ba3b4-4f47-4d9f-ba72-eabe770ffc30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1cbc10ca 2021-04-14T13:28:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d3ba3b4-4f47-4d9f-ba72-eabe770ffc30 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:28:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1d3ba3b4-4f47-4d9f-ba72-eabe770ffc30 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:03.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=943ceb89-ed03-4814-9c6c-28caa649ed20 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:03.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=943ceb89-ed03-4814-9c6c-28caa649ed20 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@133c94cf 2021-04-14T13:29:03.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=943ceb89-ed03-4814-9c6c-28caa649ed20 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:03.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=943ceb89-ed03-4814-9c6c-28caa649ed20 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:29:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:29:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:29:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:29:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:29:04.352Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:29:06.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b7a690-2bcf-4024-81e2-4143d116face PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:06.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b7a690-2bcf-4024-81e2-4143d116face PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e039db5 2021-04-14T13:29:06.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b7a690-2bcf-4024-81e2-4143d116face PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:06.013Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39b7a690-2bcf-4024-81e2-4143d116face PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:06.238Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=57da09e8-9191-4b6d-9b82-0a122974fd0a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:29:06.238645Z InvocationID=3eb5980a-bb59-4f80-8dd4-665d8ca3efce LogTimestamp=2021-04-14T13:29:06.238697Z Entering 2021-04-14T13:29:06.239Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=57da09e8-9191-4b6d-9b82-0a122974fd0a InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:29:06.238645Z InvocationID=3eb5980a-bb59-4f80-8dd4-665d8ca3efce LogTimestamp=2021-04-14T13:29:06.238697Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:29:06.240Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:29:06.239Z InvocationID=e141ef7a-d145-4b37-a06f-a2ed96063739 LogTimestamp=2021-04-14T13:29:06.240090Z ResponseDesc=OK Exiting. 2021-04-14T13:29:06.240Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:29:09.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79ffaffd-c147-4ebb-9c4f-1b3f8938b3a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:09.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79ffaffd-c147-4ebb-9c4f-1b3f8938b3a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@186b2679 2021-04-14T13:29:09.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79ffaffd-c147-4ebb-9c4f-1b3f8938b3a2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:09.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=79ffaffd-c147-4ebb-9c4f-1b3f8938b3a2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaac0c7a-8c75-4016-88e8-4c66a5c02a32 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaac0c7a-8c75-4016-88e8-4c66a5c02a32 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@642d5ffe 2021-04-14T13:29:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaac0c7a-8c75-4016-88e8-4c66a5c02a32 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:12.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaac0c7a-8c75-4016-88e8-4c66a5c02a32 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcf3228-4773-45fb-af48-0bf075282207 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcf3228-4773-45fb-af48-0bf075282207 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13c02558 2021-04-14T13:29:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcf3228-4773-45fb-af48-0bf075282207 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7fcf3228-4773-45fb-af48-0bf075282207 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:17.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7674cdd0-8cb3-4014-88ad-e88ae6f4eb8f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:17.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7674cdd0-8cb3-4014-88ad-e88ae6f4eb8f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71ccfca0 2021-04-14T13:29:17.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7674cdd0-8cb3-4014-88ad-e88ae6f4eb8f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:17.899Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7674cdd0-8cb3-4014-88ad-e88ae6f4eb8f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c68eec-4035-4a1b-947f-433744a1f2ae PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c68eec-4035-4a1b-947f-433744a1f2ae PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30d5540e 2021-04-14T13:29:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c68eec-4035-4a1b-947f-433744a1f2ae PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=68c68eec-4035-4a1b-947f-433744a1f2ae PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5651748b-66db-48b8-8c3a-48c914800406 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5651748b-66db-48b8-8c3a-48c914800406 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e093f45 2021-04-14T13:29:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5651748b-66db-48b8-8c3a-48c914800406 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:24.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5651748b-66db-48b8-8c3a-48c914800406 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541fd35e-5bc3-45b5-bad4-7af407b7bca6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541fd35e-5bc3-45b5-bad4-7af407b7bca6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cf12739 2021-04-14T13:29:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541fd35e-5bc3-45b5-bad4-7af407b7bca6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:27.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=541fd35e-5bc3-45b5-bad4-7af407b7bca6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ef4281-09fc-4ca1-90ef-fcdd4c0534a2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ef4281-09fc-4ca1-90ef-fcdd4c0534a2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a4ee7fb 2021-04-14T13:29:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ef4281-09fc-4ca1-90ef-fcdd4c0534a2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:29.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f5ef4281-09fc-4ca1-90ef-fcdd4c0534a2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:33.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9a747e-8552-484e-80f9-2e7d8e907e69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:33.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9a747e-8552-484e-80f9-2e7d8e907e69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2021b198 2021-04-14T13:29:33.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9a747e-8552-484e-80f9-2e7d8e907e69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:33.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b9a747e-8552-484e-80f9-2e7d8e907e69 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:36.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=297c104a-8656-4c71-895f-2c3acc985ed9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:36.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=297c104a-8656-4c71-895f-2c3acc985ed9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@572551ce 2021-04-14T13:29:36.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=297c104a-8656-4c71-895f-2c3acc985ed9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:36.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=297c104a-8656-4c71-895f-2c3acc985ed9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:36.232Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=766d97af-689c-407a-9b12-436307d51e88 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:29:36.231720Z InvocationID=ce500803-31bf-46d0-8669-8486eaf334ae LogTimestamp=2021-04-14T13:29:36.231825Z Entering 2021-04-14T13:29:36.232Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=766d97af-689c-407a-9b12-436307d51e88 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:29:36.231720Z InvocationID=ce500803-31bf-46d0-8669-8486eaf334ae LogTimestamp=2021-04-14T13:29:36.231825Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:29:36.235Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=3 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:29:36.232Z InvocationID=08c1320d-291f-4da1-8acd-6b5b36380bfb LogTimestamp=2021-04-14T13:29:36.235078Z ResponseDesc=OK Exiting. 2021-04-14T13:29:36.235Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:29:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0616b94-7d35-41ac-9dd1-484f77e8d877 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0616b94-7d35-41ac-9dd1-484f77e8d877 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72c86cfc 2021-04-14T13:29:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0616b94-7d35-41ac-9dd1-484f77e8d877 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:38.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b0616b94-7d35-41ac-9dd1-484f77e8d877 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93785edf-89ce-4537-ace8-dc079e4d59b2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93785edf-89ce-4537-ace8-dc079e4d59b2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ff43c61 2021-04-14T13:29:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93785edf-89ce-4537-ace8-dc079e4d59b2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:41.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93785edf-89ce-4537-ace8-dc079e4d59b2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb62d7e-468d-4bbc-a845-035de2682cdb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb62d7e-468d-4bbc-a845-035de2682cdb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1274f776 2021-04-14T13:29:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb62d7e-468d-4bbc-a845-035de2682cdb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:44.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aeb62d7e-468d-4bbc-a845-035de2682cdb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:29:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:29:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d014c9e-41ce-4aba-9e05-f81f491001cd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d014c9e-41ce-4aba-9e05-f81f491001cd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f226fd7 2021-04-14T13:29:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d014c9e-41ce-4aba-9e05-f81f491001cd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d014c9e-41ce-4aba-9e05-f81f491001cd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:48.241Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=cf5298fc-06e0-4f64-b309-78aa76741bd3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:29:48.241575Z InvocationID=d5e57d78-d4da-4140-9d74-03f843fc1a54 LogTimestamp=2021-04-14T13:29:48.241625Z Entering 2021-04-14T13:29:48.241Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=cf5298fc-06e0-4f64-b309-78aa76741bd3 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:29:48.241575Z InvocationID=d5e57d78-d4da-4140-9d74-03f843fc1a54 LogTimestamp=2021-04-14T13:29:48.241625Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:29:48.243Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:29:48.242Z InvocationID=016ac7cc-fef1-4ede-95a9-290cb4aec415 LogTimestamp=2021-04-14T13:29:48.243158Z ResponseDesc=OK Exiting. 2021-04-14T13:29:48.243Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:29:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a37c4ac2-d5b1-4d60-8075-31df1d02bed9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a37c4ac2-d5b1-4d60-8075-31df1d02bed9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e3c4143 2021-04-14T13:29:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a37c4ac2-d5b1-4d60-8075-31df1d02bed9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a37c4ac2-d5b1-4d60-8075-31df1d02bed9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ead96a74-d2f1-4ae3-9b5c-c92a5faae4e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ead96a74-d2f1-4ae3-9b5c-c92a5faae4e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@403579d1 2021-04-14T13:29:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ead96a74-d2f1-4ae3-9b5c-c92a5faae4e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:53.847Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ead96a74-d2f1-4ae3-9b5c-c92a5faae4e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:56.931Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20169-ea5a-4f89-a35f-1130347377bc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:56.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20169-ea5a-4f89-a35f-1130347377bc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@75cfe9e6 2021-04-14T13:29:56.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20169-ea5a-4f89-a35f-1130347377bc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:56.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fbb20169-ea5a-4f89-a35f-1130347377bc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:29:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6508e2d4-dad3-41cc-bc0e-69cd0d689f11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:29:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6508e2d4-dad3-41cc-bc0e-69cd0d689f11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9ef7c5f 2021-04-14T13:29:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6508e2d4-dad3-41cc-bc0e-69cd0d689f11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:29:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6508e2d4-dad3-41cc-bc0e-69cd0d689f11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaca3e87-c40d-4f5e-8050-47ac7ce94f3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaca3e87-c40d-4f5e-8050-47ac7ce94f3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35e50278 2021-04-14T13:30:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaca3e87-c40d-4f5e-8050-47ac7ce94f3c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:02.924Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaca3e87-c40d-4f5e-8050-47ac7ce94f3c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:04.351Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:30:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:30:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:30:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:30:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:30:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:30:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88897164-98f3-44b8-a6ee-9f603d77766b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88897164-98f3-44b8-a6ee-9f603d77766b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e751ee4 2021-04-14T13:30:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88897164-98f3-44b8-a6ee-9f603d77766b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:06.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88897164-98f3-44b8-a6ee-9f603d77766b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:06.233Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=d4de1257-4b8a-4239-8fc1-fb6131a24ccf InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:30:06.233255Z InvocationID=cd81f4e3-0820-4c70-a0ff-6137275b869c LogTimestamp=2021-04-14T13:30:06.233304Z Entering 2021-04-14T13:30:06.233Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=d4de1257-4b8a-4239-8fc1-fb6131a24ccf InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:30:06.233255Z InvocationID=cd81f4e3-0820-4c70-a0ff-6137275b869c LogTimestamp=2021-04-14T13:30:06.233304Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:30:06.234Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:30:06.233Z InvocationID=c7941181-81bb-4a9e-8095-2cde5480f7b3 LogTimestamp=2021-04-14T13:30:06.234272Z ResponseDesc=OK Exiting. 2021-04-14T13:30:06.234Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:30:06.322Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e019d3fd-6de9-4d59-ab7c-4150818c355e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:30:06.322217Z InvocationID=133141a8-7895-4ff4-9425-ce8f6e63a33c LogTimestamp=2021-04-14T13:30:06.322240Z Entering 2021-04-14T13:30:06.322Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e019d3fd-6de9-4d59-ab7c-4150818c355e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:30:06.322217Z InvocationID=133141a8-7895-4ff4-9425-ce8f6e63a33c LogTimestamp=2021-04-14T13:30:06.322240Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:30:06.323Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:30:06.322Z InvocationID=e1aec5b3-7f6c-45c1-b958-f63a46309b66 LogTimestamp=2021-04-14T13:30:06.323300Z ResponseDesc=OK Exiting. 2021-04-14T13:30:06.323Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:30:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34216502-e664-4e7a-bef7-626ac4210b4a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34216502-e664-4e7a-bef7-626ac4210b4a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@547f5c15 2021-04-14T13:30:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34216502-e664-4e7a-bef7-626ac4210b4a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:09.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=34216502-e664-4e7a-bef7-626ac4210b4a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe9dd44-d932-45a5-8ed0-98c1d53632b3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe9dd44-d932-45a5-8ed0-98c1d53632b3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d1f448c 2021-04-14T13:30:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe9dd44-d932-45a5-8ed0-98c1d53632b3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:12.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dbe9dd44-d932-45a5-8ed0-98c1d53632b3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:14.799Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c166b9e5-a401-43a5-b963-f29aacee1ea2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:14.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c166b9e5-a401-43a5-b963-f29aacee1ea2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@632e26ce 2021-04-14T13:30:14.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c166b9e5-a401-43a5-b963-f29aacee1ea2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:14.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c166b9e5-a401-43a5-b963-f29aacee1ea2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2e69466-7cab-4d34-9b46-02929913817c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2e69466-7cab-4d34-9b46-02929913817c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@43f4973d 2021-04-14T13:30:17.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2e69466-7cab-4d34-9b46-02929913817c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:17.844Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2e69466-7cab-4d34-9b46-02929913817c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:20.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7b7bbe-621c-4745-bcd9-894d2ee5b58d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:20.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7b7bbe-621c-4745-bcd9-894d2ee5b58d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27822acf 2021-04-14T13:30:20.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7b7bbe-621c-4745-bcd9-894d2ee5b58d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:20.583Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=af7b7bbe-621c-4745-bcd9-894d2ee5b58d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:24.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242d48ca-1506-4f8b-a1bc-b4fa32c8fd55 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:24.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242d48ca-1506-4f8b-a1bc-b4fa32c8fd55 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@100e3197 2021-04-14T13:30:24.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242d48ca-1506-4f8b-a1bc-b4fa32c8fd55 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:24.137Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=242d48ca-1506-4f8b-a1bc-b4fa32c8fd55 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3b178c-54fc-49cb-87b6-b9e226c3a422 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3b178c-54fc-49cb-87b6-b9e226c3a422 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2846d0e 2021-04-14T13:30:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3b178c-54fc-49cb-87b6-b9e226c3a422 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9a3b178c-54fc-49cb-87b6-b9e226c3a422 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:30.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02c15549-46a0-443c-b13d-b966a0b7e78c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:30.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02c15549-46a0-443c-b13d-b966a0b7e78c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@652e5f1c 2021-04-14T13:30:30.124Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02c15549-46a0-443c-b13d-b966a0b7e78c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:30.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=02c15549-46a0-443c-b13d-b966a0b7e78c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368ad980-a4b3-4e8b-9d89-99c1f45f33b1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368ad980-a4b3-4e8b-9d89-99c1f45f33b1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53ccc524 2021-04-14T13:30:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368ad980-a4b3-4e8b-9d89-99c1f45f33b1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=368ad980-a4b3-4e8b-9d89-99c1f45f33b1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:34.639Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node019x4j0w43n1xikkei49zf7iwq503 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0av03ocs4qv1q10etgwdh9jbm7498 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01w01yxn3u9ho6bc4h23thnau6509 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node06a4wymm0detyk30qrp0vp8uz484 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bxnw9c6l2lq472kq9qzs3h0496 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node017esiecu01q0g1uzgomilmr4p4510 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01r5v9yunwwyy314rixputet8fc512 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01bgnh4ans7oug1s5sl5cdmror9513 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0mwp5404fhtr08lw12zd0dj4x508 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0row20p2rzpco1s3qvla3uwt7v495 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0oe79nm0k85os1ggpnr57ycy7w516 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ta6v5t9so2c11sdm3x98f7pzr489 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k5ccw88u3pv248vr9rw8z47x517 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0fbqizsqc7gq0ihd30menco5p507 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0zxxd4qsv98f33ny4vh3k2k3w511 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01rqwvxlwpidhl1eo1dn13mq1si520 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01s7jblc9il6efl39aokq4s1p5488 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01btnwp5vpk23i1hstsbr351qj4504 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07gd6307xzfv1sm72mlpq12no497 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01niwbx1i1q9lq6gmcf0k1m0ps521 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01lwzq0wwoaqqy7sdw57bc3dyv519 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01714mg1q3dyvibxh54taxjmmi485 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0eoe4dejgn9ti1dixy02qfsr0k499 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01usjn8nmryi7h294tzijms1ly492 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0kzfx0hmpg9beqy0ivy5j75sa501 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0o1boi1smtq41075xbg98cmd9506 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01l3fwb4admp6nc2crk4zwl7mt482 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01o2038ennfbfjc3pbk36n8d56483 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0wftlos2qqykes6unmejrt5jz490 2021-04-14T13:30:34.640Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0l37wa6iryxmfkl2c9zpoewmz486 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node03tgx420vjm8j84jawjwv1fmq515 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01hb93glai2y1y4o8xetelt4h5494 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bpxz7bvoa6y3e9d6ecudoj1e487 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0p62yuvuk2easfgq7253c24ov514 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0g4y1ij18jj6invngezl64v75505 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bkd7b36ul9mm1cn45gidtwwf1500 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qv3oq66iu7ap14o8dy91roon0518 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0j9bmsigrt2qa1g28dl82yn0as502 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node03gleje5upj241fzcumyoj1crt491 2021-04-14T13:30:34.641Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0k7xmshx53ygf1gnxco9kks5hh493 2021-04-14T13:30:35.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b51af555-5190-4b97-a5ee-20c00cc3e2c5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:35.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b51af555-5190-4b97-a5ee-20c00cc3e2c5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32afd443 2021-04-14T13:30:35.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b51af555-5190-4b97-a5ee-20c00cc3e2c5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:35.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b51af555-5190-4b97-a5ee-20c00cc3e2c5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:36.238Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e6bd950b-a005-413a-ad70-f892518d1e62 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:30:36.237830Z InvocationID=6c3403ce-0c9d-4af7-8125-b61e079147cd LogTimestamp=2021-04-14T13:30:36.237915Z Entering 2021-04-14T13:30:36.238Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e6bd950b-a005-413a-ad70-f892518d1e62 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:30:36.237830Z InvocationID=6c3403ce-0c9d-4af7-8125-b61e079147cd LogTimestamp=2021-04-14T13:30:36.237915Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:30:36.240Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:30:36.239Z InvocationID=e4d16804-78d9-4d7c-897d-61232e9c4d4b LogTimestamp=2021-04-14T13:30:36.240827Z ResponseDesc=OK Exiting. 2021-04-14T13:30:36.241Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:30:38.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=053b4440-2ed9-40af-b81c-f84c37443179 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:38.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=053b4440-2ed9-40af-b81c-f84c37443179 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@13622305 2021-04-14T13:30:38.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=053b4440-2ed9-40af-b81c-f84c37443179 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:38.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=053b4440-2ed9-40af-b81c-f84c37443179 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:41.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b998d27-4a38-4f02-9f3f-32a212489cbb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:41.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b998d27-4a38-4f02-9f3f-32a212489cbb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@42348ca 2021-04-14T13:30:41.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b998d27-4a38-4f02-9f3f-32a212489cbb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:41.605Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0b998d27-4a38-4f02-9f3f-32a212489cbb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:45.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73084d13-a42d-415b-b83b-7a461fed1b60 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:45.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73084d13-a42d-415b-b83b-7a461fed1b60 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3173588f 2021-04-14T13:30:45.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73084d13-a42d-415b-b83b-7a461fed1b60 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:45.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=73084d13-a42d-415b-b83b-7a461fed1b60 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:46.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:46.205Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:46.206Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:30:46.207Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:30:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d29e0c-69ef-4f2c-9849-0df95a624d7e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d29e0c-69ef-4f2c-9849-0df95a624d7e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d329f2e 2021-04-14T13:30:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d29e0c-69ef-4f2c-9849-0df95a624d7e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:47.800Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=53d29e0c-69ef-4f2c-9849-0df95a624d7e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28954fa-afeb-460f-9ed7-a3720516c7e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28954fa-afeb-460f-9ed7-a3720516c7e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f4ae186 2021-04-14T13:30:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28954fa-afeb-460f-9ed7-a3720516c7e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:51.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e28954fa-afeb-460f-9ed7-a3720516c7e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b06bbfea-7295-4989-ad12-a23af31ca708 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b06bbfea-7295-4989-ad12-a23af31ca708 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@61b193bd 2021-04-14T13:30:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b06bbfea-7295-4989-ad12-a23af31ca708 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:54.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b06bbfea-7295-4989-ad12-a23af31ca708 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c970396-7139-4067-b2f3-7c2c833047b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c970396-7139-4067-b2f3-7c2c833047b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4aad1824 2021-04-14T13:30:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c970396-7139-4067-b2f3-7c2c833047b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:56.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1c970396-7139-4067-b2f3-7c2c833047b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:30:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ed50aa-f127-49df-acef-8b4e101ead6b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:30:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ed50aa-f127-49df-acef-8b4e101ead6b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@238f35b0 2021-04-14T13:30:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ed50aa-f127-49df-acef-8b4e101ead6b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:30:59.570Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d5ed50aa-f127-49df-acef-8b4e101ead6b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1883866e-cb94-40e8-b7ae-539aa486908e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1883866e-cb94-40e8-b7ae-539aa486908e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@be1b696 2021-04-14T13:31:02.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1883866e-cb94-40e8-b7ae-539aa486908e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:02.734Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1883866e-cb94-40e8-b7ae-539aa486908e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:31:04.351Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:31:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:31:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:31:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:31:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:31:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd8403b-a24f-4ce8-bf40-cc205df359b7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd8403b-a24f-4ce8-bf40-cc205df359b7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66a0f02c 2021-04-14T13:31:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd8403b-a24f-4ce8-bf40-cc205df359b7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd8403b-a24f-4ce8-bf40-cc205df359b7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:06.242Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1063459d-46d2-4990-b3c9-5d8a1020e9e2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:06.242620Z InvocationID=65c338cf-d463-4ef9-b05b-4129fcdb20f0 LogTimestamp=2021-04-14T13:31:06.242686Z Entering 2021-04-14T13:31:06.243Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1063459d-46d2-4990-b3c9-5d8a1020e9e2 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:06.242620Z InvocationID=65c338cf-d463-4ef9-b05b-4129fcdb20f0 LogTimestamp=2021-04-14T13:31:06.242686Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:31:06.246Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:31:06.244Z InvocationID=3c525eb5-8170-436f-a60b-38f3ead885af LogTimestamp=2021-04-14T13:31:06.246555Z ResponseDesc=OK Exiting. 2021-04-14T13:31:06.246Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:31:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99581e9-6d63-4512-b82b-04da22207e49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99581e9-6d63-4512-b82b-04da22207e49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44eeb8e4 2021-04-14T13:31:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99581e9-6d63-4512-b82b-04da22207e49 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:09.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f99581e9-6d63-4512-b82b-04da22207e49 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17684db0-df77-435c-9edd-8d39ca6bdc7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17684db0-df77-435c-9edd-8d39ca6bdc7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e16377c 2021-04-14T13:31:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17684db0-df77-435c-9edd-8d39ca6bdc7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:12.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17684db0-df77-435c-9edd-8d39ca6bdc7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=212397a8-dad8-4d6f-a599-1ecac05cea5c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=212397a8-dad8-4d6f-a599-1ecac05cea5c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18c5672e 2021-04-14T13:31:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=212397a8-dad8-4d6f-a599-1ecac05cea5c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=212397a8-dad8-4d6f-a599-1ecac05cea5c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2374700-ff88-4cb4-9f60-daeede351754 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2374700-ff88-4cb4-9f60-daeede351754 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7905c58a 2021-04-14T13:31:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2374700-ff88-4cb4-9f60-daeede351754 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:17.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b2374700-ff88-4cb4-9f60-daeede351754 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=071947fb-a57d-4408-8db4-e48d9d4a78be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=071947fb-a57d-4408-8db4-e48d9d4a78be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@489d7bd6 2021-04-14T13:31:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=071947fb-a57d-4408-8db4-e48d9d4a78be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:20.541Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=071947fb-a57d-4408-8db4-e48d9d4a78be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:24.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33379841-ec17-4362-ad56-e66b5bb3c6ab PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:24.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33379841-ec17-4362-ad56-e66b5bb3c6ab PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@679f186e 2021-04-14T13:31:24.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33379841-ec17-4362-ad56-e66b5bb3c6ab PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:24.021Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33379841-ec17-4362-ad56-e66b5bb3c6ab PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:27.152Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8e8cbe1-6504-41b6-97d9-eccbb732961b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:27.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8e8cbe1-6504-41b6-97d9-eccbb732961b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@54d0ffa4 2021-04-14T13:31:27.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8e8cbe1-6504-41b6-97d9-eccbb732961b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:27.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8e8cbe1-6504-41b6-97d9-eccbb732961b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1527cf97-ff95-478f-9cb9-62e255d82cf2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1527cf97-ff95-478f-9cb9-62e255d82cf2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ae5921 2021-04-14T13:31:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1527cf97-ff95-478f-9cb9-62e255d82cf2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:30.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1527cf97-ff95-478f-9cb9-62e255d82cf2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f077645-270c-4ebb-b402-a2a8768fe953 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f077645-270c-4ebb-b402-a2a8768fe953 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20cec149 2021-04-14T13:31:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f077645-270c-4ebb-b402-a2a8768fe953 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f077645-270c-4ebb-b402-a2a8768fe953 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95dba740-dc30-494c-9ce7-c0182d0ea802 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95dba740-dc30-494c-9ce7-c0182d0ea802 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f0de156 2021-04-14T13:31:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95dba740-dc30-494c-9ce7-c0182d0ea802 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=95dba740-dc30-494c-9ce7-c0182d0ea802 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:36.238Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=a70a6aca-63a7-4dc5-9297-3099f190630d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:36.238267Z InvocationID=6a6fe996-12f4-4173-8329-3794318e4894 LogTimestamp=2021-04-14T13:31:36.238315Z Entering 2021-04-14T13:31:36.238Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=a70a6aca-63a7-4dc5-9297-3099f190630d InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:36.238267Z InvocationID=6a6fe996-12f4-4173-8329-3794318e4894 LogTimestamp=2021-04-14T13:31:36.238315Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:31:36.239Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:31:36.238Z InvocationID=e512c436-c1df-4762-b18b-62c5f8102ef7 LogTimestamp=2021-04-14T13:31:36.239568Z ResponseDesc=OK Exiting. 2021-04-14T13:31:36.239Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:31:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58d061d-46b0-40f5-8026-07dbd6ae3495 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58d061d-46b0-40f5-8026-07dbd6ae3495 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c7314cc 2021-04-14T13:31:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58d061d-46b0-40f5-8026-07dbd6ae3495 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:38.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e58d061d-46b0-40f5-8026-07dbd6ae3495 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:41.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e290c83-a9ca-4065-94c7-5d3245a3959a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:41.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e290c83-a9ca-4065-94c7-5d3245a3959a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1de52f32 2021-04-14T13:31:41.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e290c83-a9ca-4065-94c7-5d3245a3959a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:41.537Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e290c83-a9ca-4065-94c7-5d3245a3959a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:42.092Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8fbdfd34-1012-4d1f-b11b-c6edfae3249b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:42.092128Z InvocationID=cdde7f31-e58c-451a-90a7-4fc30078e417 LogTimestamp=2021-04-14T13:31:42.092156Z Entering 2021-04-14T13:31:42.092Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8fbdfd34-1012-4d1f-b11b-c6edfae3249b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:42.092128Z InvocationID=cdde7f31-e58c-451a-90a7-4fc30078e417 LogTimestamp=2021-04-14T13:31:42.092156Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:31:42.093Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:31:42.092Z InvocationID=0933b808-87c7-4f5e-984d-3f7e28098a20 LogTimestamp=2021-04-14T13:31:42.093641Z ResponseDesc=OK Exiting. 2021-04-14T13:31:42.093Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:31:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88da5d8a-9fcb-481d-ae43-65cb86aa9f09 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88da5d8a-9fcb-481d-ae43-65cb86aa9f09 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bf7714e 2021-04-14T13:31:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88da5d8a-9fcb-481d-ae43-65cb86aa9f09 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:45.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88da5d8a-9fcb-481d-ae43-65cb86aa9f09 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:31:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:31:47.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2245812-2cf1-4c33-99d0-4d6087307d70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:47.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2245812-2cf1-4c33-99d0-4d6087307d70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ba02e37 2021-04-14T13:31:47.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2245812-2cf1-4c33-99d0-4d6087307d70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:47.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f2245812-2cf1-4c33-99d0-4d6087307d70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:48.213Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=31dff42b-f195-41ef-8a90-42aa38e95284 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:48.213425Z InvocationID=e186d236-f3e9-4e32-bbde-afe6798b0e0f LogTimestamp=2021-04-14T13:31:48.213467Z Entering 2021-04-14T13:31:48.213Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=31dff42b-f195-41ef-8a90-42aa38e95284 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:31:48.213425Z InvocationID=e186d236-f3e9-4e32-bbde-afe6798b0e0f LogTimestamp=2021-04-14T13:31:48.213467Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:31:48.214Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:31:48.213Z InvocationID=2d358e9a-2b0a-4e81-a8d1-57709a10d89a LogTimestamp=2021-04-14T13:31:48.214737Z ResponseDesc=OK Exiting. 2021-04-14T13:31:48.214Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:31:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a762ebd-ef17-43fa-8322-9aafd251b5c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a762ebd-ef17-43fa-8322-9aafd251b5c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f818cfb 2021-04-14T13:31:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a762ebd-ef17-43fa-8322-9aafd251b5c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:51.312Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6a762ebd-ef17-43fa-8322-9aafd251b5c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:53.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93b02cae-ae0e-40a7-8a54-afb92e4ba5ac PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:53.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93b02cae-ae0e-40a7-8a54-afb92e4ba5ac PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ba9b286 2021-04-14T13:31:53.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93b02cae-ae0e-40a7-8a54-afb92e4ba5ac PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:53.864Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=93b02cae-ae0e-40a7-8a54-afb92e4ba5ac PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9280022d-ee1c-4559-b491-e2faa7d0f7a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9280022d-ee1c-4559-b491-e2faa7d0f7a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b24c5bc 2021-04-14T13:31:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9280022d-ee1c-4559-b491-e2faa7d0f7a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:56.892Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9280022d-ee1c-4559-b491-e2faa7d0f7a3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:31:59.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf438173-d776-417f-baf6-c6d9aaf791aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:31:59.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf438173-d776-417f-baf6-c6d9aaf791aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@31ef9779 2021-04-14T13:31:59.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf438173-d776-417f-baf6-c6d9aaf791aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:31:59.564Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf438173-d776-417f-baf6-c6d9aaf791aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65537860-3e84-44b0-9d3e-642907593480 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65537860-3e84-44b0-9d3e-642907593480 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@52ea33eb 2021-04-14T13:32:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65537860-3e84-44b0-9d3e-642907593480 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:02.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=65537860-3e84-44b0-9d3e-642907593480 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:32:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:32:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:32:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:32:04.358Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:04.359Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:32:04.359Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:32:06.227Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f64f23fc-7820-45e7-b1f3-3ad2b2456646 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:32:06.226785Z InvocationID=c6c1c348-edec-4829-8b10-de665423f61b LogTimestamp=2021-04-14T13:32:06.226875Z Entering 2021-04-14T13:32:06.227Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f64f23fc-7820-45e7-b1f3-3ad2b2456646 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:32:06.226785Z InvocationID=c6c1c348-edec-4829-8b10-de665423f61b LogTimestamp=2021-04-14T13:32:06.226875Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:32:06.229Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:32:06.227Z InvocationID=07f326a6-7356-4079-9b76-0984224d7d3f LogTimestamp=2021-04-14T13:32:06.229628Z ResponseDesc=OK Exiting. 2021-04-14T13:32:06.229Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:32:06.281Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eff650c-9d50-49bd-8fea-f6eebd25f9d0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eff650c-9d50-49bd-8fea-f6eebd25f9d0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44c186b2 2021-04-14T13:32:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eff650c-9d50-49bd-8fea-f6eebd25f9d0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:06.282Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1eff650c-9d50-49bd-8fea-f6eebd25f9d0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f5a6ba-6419-428b-98bc-f6617254e164 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f5a6ba-6419-428b-98bc-f6617254e164 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4945a2b3 2021-04-14T13:32:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f5a6ba-6419-428b-98bc-f6617254e164 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:09.283Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b8f5a6ba-6419-428b-98bc-f6617254e164 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:12.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edde5df0-72a0-46ce-a44a-13412b406b49 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:12.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edde5df0-72a0-46ce-a44a-13412b406b49 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4dcb0bd 2021-04-14T13:32:12.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edde5df0-72a0-46ce-a44a-13412b406b49 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:12.136Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=edde5df0-72a0-46ce-a44a-13412b406b49 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b028290e-28b0-494f-9ca1-8dfd902fc946 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b028290e-28b0-494f-9ca1-8dfd902fc946 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aaaea6 2021-04-14T13:32:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b028290e-28b0-494f-9ca1-8dfd902fc946 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:14.681Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b028290e-28b0-494f-9ca1-8dfd902fc946 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:17.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=095dec1a-523d-4c48-8429-9462dd5c2927 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:17.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=095dec1a-523d-4c48-8429-9462dd5c2927 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4f164cf7 2021-04-14T13:32:17.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=095dec1a-523d-4c48-8429-9462dd5c2927 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:17.984Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=095dec1a-523d-4c48-8429-9462dd5c2927 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19550eea-ae6e-4bbf-ad04-e907fd8c9171 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19550eea-ae6e-4bbf-ad04-e907fd8c9171 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ba22f9c 2021-04-14T13:32:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19550eea-ae6e-4bbf-ad04-e907fd8c9171 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=19550eea-ae6e-4bbf-ad04-e907fd8c9171 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ab10b7-4dfa-45a0-9e0c-db51c8b2fd1f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ab10b7-4dfa-45a0-9e0c-db51c8b2fd1f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a1a3b0d 2021-04-14T13:32:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ab10b7-4dfa-45a0-9e0c-db51c8b2fd1f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:24.032Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6ab10b7-4dfa-45a0-9e0c-db51c8b2fd1f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:26.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1427b38-fbaf-481e-b631-fc286f7d6659 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:26.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1427b38-fbaf-481e-b631-fc286f7d6659 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18977376 2021-04-14T13:32:26.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1427b38-fbaf-481e-b631-fc286f7d6659 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:26.900Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b1427b38-fbaf-481e-b631-fc286f7d6659 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a046c12-2387-47f4-afa7-6d3b310c4dd6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a046c12-2387-47f4-afa7-6d3b310c4dd6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@651bf567 2021-04-14T13:32:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a046c12-2387-47f4-afa7-6d3b310c4dd6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:30.010Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a046c12-2387-47f4-afa7-6d3b310c4dd6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:33.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6a498a-18c2-461a-969d-dc7326301954 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:33.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6a498a-18c2-461a-969d-dc7326301954 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f7ff897 2021-04-14T13:32:33.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6a498a-18c2-461a-969d-dc7326301954 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:33.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=de6a498a-18c2-461a-969d-dc7326301954 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b13f5dc-4727-48fa-85af-38fcbab2ab68 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b13f5dc-4727-48fa-85af-38fcbab2ab68 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@44266226 2021-04-14T13:32:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b13f5dc-4727-48fa-85af-38fcbab2ab68 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:35.983Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b13f5dc-4727-48fa-85af-38fcbab2ab68 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:36.221Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=694b7e58-6971-4cc1-a631-d90c7a82a657 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:32:36.221632Z InvocationID=b33bc996-d7a9-4661-8175-76bb5b3c7087 LogTimestamp=2021-04-14T13:32:36.221700Z Entering 2021-04-14T13:32:36.222Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=694b7e58-6971-4cc1-a631-d90c7a82a657 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:32:36.221632Z InvocationID=b33bc996-d7a9-4661-8175-76bb5b3c7087 LogTimestamp=2021-04-14T13:32:36.221700Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:32:36.223Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:32:36.222Z InvocationID=80b73630-d335-4ab9-9802-854c3cd643a6 LogTimestamp=2021-04-14T13:32:36.223467Z ResponseDesc=OK Exiting. 2021-04-14T13:32:36.223Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:32:39.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe3a6ce-3181-4e48-9caa-b9f68b06627c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:39.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe3a6ce-3181-4e48-9caa-b9f68b06627c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6789b517 2021-04-14T13:32:39.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe3a6ce-3181-4e48-9caa-b9f68b06627c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:39.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bfe3a6ce-3181-4e48-9caa-b9f68b06627c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a396d1-8b6b-4e60-99a0-c34da6352c3c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a396d1-8b6b-4e60-99a0-c34da6352c3c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d03c44c 2021-04-14T13:32:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a396d1-8b6b-4e60-99a0-c34da6352c3c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:41.552Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=01a396d1-8b6b-4e60-99a0-c34da6352c3c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f79611-b197-452d-96a6-1cb3a57342c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f79611-b197-452d-96a6-1cb3a57342c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7d18343b 2021-04-14T13:32:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f79611-b197-452d-96a6-1cb3a57342c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:44.915Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50f79611-b197-452d-96a6-1cb3a57342c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:46.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:46.201Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:32:46.202Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:32:47.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf86ca5-3be1-44c9-9aaf-e40ff5e4f034 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:47.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf86ca5-3be1-44c9-9aaf-e40ff5e4f034 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@ad84eec 2021-04-14T13:32:47.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf86ca5-3be1-44c9-9aaf-e40ff5e4f034 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:47.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7cf86ca5-3be1-44c9-9aaf-e40ff5e4f034 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b34369-bdc3-4c38-91cc-d968541c8374 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b34369-bdc3-4c38-91cc-d968541c8374 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20d363ad 2021-04-14T13:32:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b34369-bdc3-4c38-91cc-d968541c8374 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:51.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2b34369-bdc3-4c38-91cc-d968541c8374 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fba3baec-d856-4d00-885d-e1c2753774b5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fba3baec-d856-4d00-885d-e1c2753774b5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63b1e25f 2021-04-14T13:32:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fba3baec-d856-4d00-885d-e1c2753774b5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:53.938Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fba3baec-d856-4d00-885d-e1c2753774b5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:57.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d973958-5404-425d-8ec1-3bf06ba5dff6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:57.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d973958-5404-425d-8ec1-3bf06ba5dff6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f34bbfe 2021-04-14T13:32:57.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d973958-5404-425d-8ec1-3bf06ba5dff6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:57.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d973958-5404-425d-8ec1-3bf06ba5dff6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:32:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e86c6a3-3dbb-44fe-b7c4-05d5381659c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:32:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e86c6a3-3dbb-44fe-b7c4-05d5381659c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@175331da 2021-04-14T13:32:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e86c6a3-3dbb-44fe-b7c4-05d5381659c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:32:59.555Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e86c6a3-3dbb-44fe-b7c4-05d5381659c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180c6fd2-0294-44db-9d26-99f7b37f22e5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180c6fd2-0294-44db-9d26-99f7b37f22e5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c26e696 2021-04-14T13:33:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180c6fd2-0294-44db-9d26-99f7b37f22e5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:02.826Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=180c6fd2-0294-44db-9d26-99f7b37f22e5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:33:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:33:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:33:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:33:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:33:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:33:06.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54966686-57bc-42a1-ba33-84b7a5dcd8f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:06.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54966686-57bc-42a1-ba33-84b7a5dcd8f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40695a57 2021-04-14T13:33:06.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54966686-57bc-42a1-ba33-84b7a5dcd8f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:06.134Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=54966686-57bc-42a1-ba33-84b7a5dcd8f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:06.247Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1c3f55b1-1386-4975-8518-7c4054eb29ee InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:06.247414Z InvocationID=ca63e59e-62ac-4855-9679-b6ec48ddf404 LogTimestamp=2021-04-14T13:33:06.247468Z Entering 2021-04-14T13:33:06.248Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1c3f55b1-1386-4975-8518-7c4054eb29ee InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:06.247414Z InvocationID=ca63e59e-62ac-4855-9679-b6ec48ddf404 LogTimestamp=2021-04-14T13:33:06.247468Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:33:06.249Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:33:06.248Z InvocationID=81d90fd9-e5c7-49f8-9a78-f0c2a58c1b05 LogTimestamp=2021-04-14T13:33:06.249354Z ResponseDesc=OK Exiting. 2021-04-14T13:33:06.249Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:33:09.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3114452d-be56-48fb-8d31-9b1473d27d03 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:09.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3114452d-be56-48fb-8d31-9b1473d27d03 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3a78e2ef 2021-04-14T13:33:09.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3114452d-be56-48fb-8d31-9b1473d27d03 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:09.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3114452d-be56-48fb-8d31-9b1473d27d03 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=164f8885-a226-470a-a6fc-d59c0892401d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=164f8885-a226-470a-a6fc-d59c0892401d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@34abd99b 2021-04-14T13:33:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=164f8885-a226-470a-a6fc-d59c0892401d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:12.039Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=164f8885-a226-470a-a6fc-d59c0892401d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:14.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4a015c-8e9e-487f-bea0-6206e5ab5225 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:14.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4a015c-8e9e-487f-bea0-6206e5ab5225 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2fa29bce 2021-04-14T13:33:14.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4a015c-8e9e-487f-bea0-6206e5ab5225 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:14.807Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bd4a015c-8e9e-487f-bea0-6206e5ab5225 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:16.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:18.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dc2f79-2e99-479e-97c0-fc1d6813c989 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:18.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dc2f79-2e99-479e-97c0-fc1d6813c989 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2593c78f 2021-04-14T13:33:18.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dc2f79-2e99-479e-97c0-fc1d6813c989 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:18.092Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dc2f79-2e99-479e-97c0-fc1d6813c989 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:20.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7a08d-ff6c-4690-b3c4-1b9dc321e6bd PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:20.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7a08d-ff6c-4690-b3c4-1b9dc321e6bd PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@58012648 2021-04-14T13:33:20.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7a08d-ff6c-4690-b3c4-1b9dc321e6bd PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:20.535Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a5c7a08d-ff6c-4690-b3c4-1b9dc321e6bd PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:24.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c711767e-c6fb-4103-9985-70b179bc7f21 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:24.131Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c711767e-c6fb-4103-9985-70b179bc7f21 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@320c4bd2 2021-04-14T13:33:24.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c711767e-c6fb-4103-9985-70b179bc7f21 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:24.132Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c711767e-c6fb-4103-9985-70b179bc7f21 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:26.030Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=ebe07ef7-8b40-4e34-9a7c-75e3e3715169 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:26.029695Z InvocationID=f3416f8d-e350-4c24-b602-35d936355ef5 LogTimestamp=2021-04-14T13:33:26.029821Z Entering 2021-04-14T13:33:26.030Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=ebe07ef7-8b40-4e34-9a7c-75e3e3715169 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:26.029695Z InvocationID=f3416f8d-e350-4c24-b602-35d936355ef5 LogTimestamp=2021-04-14T13:33:26.029821Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:33:26.032Z [qtp580718781-14] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:33:26.030Z InvocationID=6825fc82-686b-46c7-8fcf-50aba4670300 LogTimestamp=2021-04-14T13:33:26.032470Z ResponseDesc=OK Exiting. 2021-04-14T13:33:26.032Z [qtp580718781-14] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:33:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=245ac70b-7862-48e7-90c2-d8c666c1aeaf PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=245ac70b-7862-48e7-90c2-d8c666c1aeaf PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@94bdab6 2021-04-14T13:33:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=245ac70b-7862-48e7-90c2-d8c666c1aeaf PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:26.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=245ac70b-7862-48e7-90c2-d8c666c1aeaf PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1163a82-887f-4ac1-9dbd-51aeb0cf8d36 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1163a82-887f-4ac1-9dbd-51aeb0cf8d36 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@32dfcbaf 2021-04-14T13:33:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1163a82-887f-4ac1-9dbd-51aeb0cf8d36 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:30.012Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1163a82-887f-4ac1-9dbd-51aeb0cf8d36 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:31.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:31.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=990e27f6-f40c-4612-8311-d9d3aae36cf5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=990e27f6-f40c-4612-8311-d9d3aae36cf5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63bd98da 2021-04-14T13:33:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=990e27f6-f40c-4612-8311-d9d3aae36cf5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:33.133Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=990e27f6-f40c-4612-8311-d9d3aae36cf5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:35.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bb4b347-aa78-46bc-b44f-3e5a9ba9c5e8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:35.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bb4b347-aa78-46bc-b44f-3e5a9ba9c5e8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@33bf1da4 2021-04-14T13:33:35.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bb4b347-aa78-46bc-b44f-3e5a9ba9c5e8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:35.801Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2bb4b347-aa78-46bc-b44f-3e5a9ba9c5e8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:36.229Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=86923392-8677-4765-872b-29a8c17bb9f6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:36.228923Z InvocationID=cfa97d51-f4c5-4add-9cb9-572a22c311a1 LogTimestamp=2021-04-14T13:33:36.228962Z Entering 2021-04-14T13:33:36.229Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=86923392-8677-4765-872b-29a8c17bb9f6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:36.228923Z InvocationID=cfa97d51-f4c5-4add-9cb9-572a22c311a1 LogTimestamp=2021-04-14T13:33:36.228962Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:33:36.231Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:33:36.229Z InvocationID=a6854366-d86a-408d-b40a-0871096119df LogTimestamp=2021-04-14T13:33:36.231382Z ResponseDesc=OK Exiting. 2021-04-14T13:33:36.231Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:33:38.952Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cc918e-9934-433d-9ec1-c9157ce2069e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:38.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cc918e-9934-433d-9ec1-c9157ce2069e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6476ef0f 2021-04-14T13:33:38.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cc918e-9934-433d-9ec1-c9157ce2069e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:38.953Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=89cc918e-9934-433d-9ec1-c9157ce2069e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890ceeca-77a1-4860-a8a8-319aedd40067 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890ceeca-77a1-4860-a8a8-319aedd40067 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2838d29d 2021-04-14T13:33:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890ceeca-77a1-4860-a8a8-319aedd40067 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=890ceeca-77a1-4860-a8a8-319aedd40067 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:45.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ea9740-3428-4921-8662-0f39a6b52ded PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:45.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ea9740-3428-4921-8662-0f39a6b52ded PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@27ccf408 2021-04-14T13:33:45.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ea9740-3428-4921-8662-0f39a6b52ded PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:45.020Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=57ea9740-3428-4921-8662-0f39a6b52ded PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:33:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:33:47.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e636b6-ebe8-4056-8bd6-f2d92cb8238a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:47.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e636b6-ebe8-4056-8bd6-f2d92cb8238a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c559f68 2021-04-14T13:33:47.980Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e636b6-ebe8-4056-8bd6-f2d92cb8238a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:47.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=48e636b6-ebe8-4056-8bd6-f2d92cb8238a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:48.216Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b617eb43-b3f5-4208-9588-5bdff15b4e96 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:48.216626Z InvocationID=48bc4946-f9fb-48a8-afdb-9774f874a980 LogTimestamp=2021-04-14T13:33:48.216666Z Entering 2021-04-14T13:33:48.217Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b617eb43-b3f5-4208-9588-5bdff15b4e96 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:33:48.216626Z InvocationID=48bc4946-f9fb-48a8-afdb-9774f874a980 LogTimestamp=2021-04-14T13:33:48.216666Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:33:48.218Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:33:48.217Z InvocationID=e5a087bb-e5ea-4f9b-ab01-c906b1bcb062 LogTimestamp=2021-04-14T13:33:48.218622Z ResponseDesc=OK Exiting. 2021-04-14T13:33:48.219Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:33:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37698a18-271c-4e49-a8ae-098ef512f0f0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37698a18-271c-4e49-a8ae-098ef512f0f0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f881b7a 2021-04-14T13:33:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37698a18-271c-4e49-a8ae-098ef512f0f0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:51.223Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=37698a18-271c-4e49-a8ae-098ef512f0f0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:53.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5143a5a3-074a-4a9b-8b37-34fd86d48a70 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:53.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5143a5a3-074a-4a9b-8b37-34fd86d48a70 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@514a8a2c 2021-04-14T13:33:53.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5143a5a3-074a-4a9b-8b37-34fd86d48a70 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:53.942Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5143a5a3-074a-4a9b-8b37-34fd86d48a70 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964cf486-9d48-41f4-ba49-8ad91dca44a3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964cf486-9d48-41f4-ba49-8ad91dca44a3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@116658b9 2021-04-14T13:33:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964cf486-9d48-41f4-ba49-8ad91dca44a3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=964cf486-9d48-41f4-ba49-8ad91dca44a3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:33:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e2f677-6d86-4ec1-a30a-b5a077e6a197 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:33:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e2f677-6d86-4ec1-a30a-b5a077e6a197 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@51882b22 2021-04-14T13:33:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e2f677-6d86-4ec1-a30a-b5a077e6a197 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:33:59.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e4e2f677-6d86-4ec1-a30a-b5a077e6a197 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931cbe39-55e6-4158-a1cf-565f05c2a936 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931cbe39-55e6-4158-a1cf-565f05c2a936 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ea4b9a2 2021-04-14T13:34:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931cbe39-55e6-4158-a1cf-565f05c2a936 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:02.821Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=931cbe39-55e6-4158-a1cf-565f05c2a936 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:04.352Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:34:04.352Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:34:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:34:04.353Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:34:04.358Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:04.359Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:34:04.360Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:34:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41cd2d9d-b2d3-4256-b6a7-4b7f62b9f43a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41cd2d9d-b2d3-4256-b6a7-4b7f62b9f43a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2bba4db0 2021-04-14T13:34:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41cd2d9d-b2d3-4256-b6a7-4b7f62b9f43a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:06.184Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=41cd2d9d-b2d3-4256-b6a7-4b7f62b9f43a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:06.240Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=2eac38a4-ea01-4783-b64b-0327cb54e219 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:34:06.239730Z InvocationID=7afb7833-693f-4b23-a78a-22322d4ecf23 LogTimestamp=2021-04-14T13:34:06.239800Z Entering 2021-04-14T13:34:06.240Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=2eac38a4-ea01-4783-b64b-0327cb54e219 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:34:06.239730Z InvocationID=7afb7833-693f-4b23-a78a-22322d4ecf23 LogTimestamp=2021-04-14T13:34:06.239800Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:34:06.242Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:34:06.240Z InvocationID=dda2dc24-abba-43cd-b483-ee970e8cfa44 LogTimestamp=2021-04-14T13:34:06.242469Z ResponseDesc=OK Exiting. 2021-04-14T13:34:06.242Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:34:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ea9c9-db65-411c-94e4-d86d550071e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ea9c9-db65-411c-94e4-d86d550071e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@83a7bee 2021-04-14T13:34:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ea9c9-db65-411c-94e4-d86d550071e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:08.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d4ea9c9-db65-411c-94e4-d86d550071e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:12.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d385a8ad-121c-4bba-a424-f0d7d2c3a50b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:12.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d385a8ad-121c-4bba-a424-f0d7d2c3a50b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@18fb90f0 2021-04-14T13:34:12.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d385a8ad-121c-4bba-a424-f0d7d2c3a50b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:12.139Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d385a8ad-121c-4bba-a424-f0d7d2c3a50b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c87988-07c0-4cb4-b9f3-a17c47877dbc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c87988-07c0-4cb4-b9f3-a17c47877dbc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@139953e4 2021-04-14T13:34:14.694Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c87988-07c0-4cb4-b9f3-a17c47877dbc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:14.695Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e8c87988-07c0-4cb4-b9f3-a17c47877dbc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:17.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec43d72-582b-427f-a1f4-d338d0b6c542 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:17.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec43d72-582b-427f-a1f4-d338d0b6c542 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6ab74bea 2021-04-14T13:34:17.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec43d72-582b-427f-a1f4-d338d0b6c542 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:17.849Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec43d72-582b-427f-a1f4-d338d0b6c542 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc29baf1-996d-4693-a87b-46a40735a746 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc29baf1-996d-4693-a87b-46a40735a746 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3189b859 2021-04-14T13:34:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc29baf1-996d-4693-a87b-46a40735a746 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:20.548Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fc29baf1-996d-4693-a87b-46a40735a746 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:24.115Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe036935-cdd9-463e-8e8e-c1e5f5b2976a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe036935-cdd9-463e-8e8e-c1e5f5b2976a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7531d288 2021-04-14T13:34:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe036935-cdd9-463e-8e8e-c1e5f5b2976a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:24.116Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe036935-cdd9-463e-8e8e-c1e5f5b2976a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15006644-f5d8-4d06-ad1e-07ae74cfc1db PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15006644-f5d8-4d06-ad1e-07ae74cfc1db PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ceeb9b9 2021-04-14T13:34:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15006644-f5d8-4d06-ad1e-07ae74cfc1db PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:27.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=15006644-f5d8-4d06-ad1e-07ae74cfc1db PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a319893f-9fed-47da-991d-55585db755ba PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a319893f-9fed-47da-991d-55585db755ba PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c564fd5 2021-04-14T13:34:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a319893f-9fed-47da-991d-55585db755ba PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:30.019Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a319893f-9fed-47da-991d-55585db755ba PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:31.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b765fb07-9ef4-43d7-ad50-7537f45ca060 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b765fb07-9ef4-43d7-ad50-7537f45ca060 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@617b76 2021-04-14T13:34:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b765fb07-9ef4-43d7-ad50-7537f45ca060 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:33.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b765fb07-9ef4-43d7-ad50-7537f45ca060 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1475c5dc-6c76-4988-aa98-1dc98349cb9a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1475c5dc-6c76-4988-aa98-1dc98349cb9a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7bbf4c60 2021-04-14T13:34:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1475c5dc-6c76-4988-aa98-1dc98349cb9a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:36.086Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1475c5dc-6c76-4988-aa98-1dc98349cb9a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:36.233Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=efcd96f1-ec26-459e-b348-44a0249e1bbe InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:34:36.232998Z InvocationID=07f919d9-bd05-4325-af1b-f13ae2118541 LogTimestamp=2021-04-14T13:34:36.233034Z Entering 2021-04-14T13:34:36.233Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=efcd96f1-ec26-459e-b348-44a0249e1bbe InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:34:36.232998Z InvocationID=07f919d9-bd05-4325-af1b-f13ae2118541 LogTimestamp=2021-04-14T13:34:36.233034Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:34:36.234Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:34:36.233Z InvocationID=3d1eb423-5af9-41fd-910a-89e37327a9b3 LogTimestamp=2021-04-14T13:34:36.234301Z ResponseDesc=OK Exiting. 2021-04-14T13:34:36.234Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:34:38.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d604eb9-93f5-49b9-8261-2b2732f28b7b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:38.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d604eb9-93f5-49b9-8261-2b2732f28b7b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@22c511df 2021-04-14T13:34:38.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d604eb9-93f5-49b9-8261-2b2732f28b7b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:38.848Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8d604eb9-93f5-49b9-8261-2b2732f28b7b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa22d1d-bf87-46ee-853e-8a40ce27d74e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa22d1d-bf87-46ee-853e-8a40ce27d74e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c23dab5 2021-04-14T13:34:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa22d1d-bf87-46ee-853e-8a40ce27d74e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:41.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aaa22d1d-bf87-46ee-853e-8a40ce27d74e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0f51b8a-8894-4b57-b041-b1fa05cd9c30 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0f51b8a-8894-4b57-b041-b1fa05cd9c30 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6792b68c 2021-04-14T13:34:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0f51b8a-8894-4b57-b041-b1fa05cd9c30 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0f51b8a-8894-4b57-b041-b1fa05cd9c30 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:34:46.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:34:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=201358a9-65f2-478f-b769-2846981b4025 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=201358a9-65f2-478f-b769-2846981b4025 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@66cf3a52 2021-04-14T13:34:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=201358a9-65f2-478f-b769-2846981b4025 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:47.995Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=201358a9-65f2-478f-b769-2846981b4025 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442a96c0-198c-47de-858f-813f2afeb830 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442a96c0-198c-47de-858f-813f2afeb830 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c8e94bd 2021-04-14T13:34:51.110Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442a96c0-198c-47de-858f-813f2afeb830 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:51.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=442a96c0-198c-47de-858f-813f2afeb830 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:54.251Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d37c04-dffa-4fc5-808a-a2da5bbd4fce PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:54.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d37c04-dffa-4fc5-808a-a2da5bbd4fce PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1e8a1deb 2021-04-14T13:34:54.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d37c04-dffa-4fc5-808a-a2da5bbd4fce PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:54.252Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00d37c04-dffa-4fc5-808a-a2da5bbd4fce PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e90648cf-91cd-4fbf-9faa-d0d182628020 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e90648cf-91cd-4fbf-9faa-d0d182628020 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cdefe60 2021-04-14T13:34:56.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e90648cf-91cd-4fbf-9faa-d0d182628020 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:56.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e90648cf-91cd-4fbf-9faa-d0d182628020 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:34:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f32bac-ed3b-4bf5-9f3e-1c313da3420d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:34:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f32bac-ed3b-4bf5-9f3e-1c313da3420d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73dc5403 2021-04-14T13:34:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f32bac-ed3b-4bf5-9f3e-1c313da3420d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:34:59.562Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=12f32bac-ed3b-4bf5-9f3e-1c313da3420d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:02.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef223ce-1378-4eeb-99d0-532f33f9c88f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:02.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef223ce-1378-4eeb-99d0-532f33f9c88f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6bef1db9 2021-04-14T13:35:02.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef223ce-1378-4eeb-99d0-532f33f9c88f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:02.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4ef223ce-1378-4eeb-99d0-532f33f9c88f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:35:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:35:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:35:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:35:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:35:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:35:06.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1d5584a-052f-4680-a76e-383ca9f72d3a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:06.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1d5584a-052f-4680-a76e-383ca9f72d3a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2544206a 2021-04-14T13:35:06.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1d5584a-052f-4680-a76e-383ca9f72d3a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:06.085Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1d5584a-052f-4680-a76e-383ca9f72d3a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:06.243Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=eb594ce7-a051-4acb-b588-9db63b92de34 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:06.243198Z InvocationID=ff03396f-544c-4a98-b9c6-00a0a95594d4 LogTimestamp=2021-04-14T13:35:06.243293Z Entering 2021-04-14T13:35:06.243Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=eb594ce7-a051-4acb-b588-9db63b92de34 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:06.243198Z InvocationID=ff03396f-544c-4a98-b9c6-00a0a95594d4 LogTimestamp=2021-04-14T13:35:06.243293Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:35:06.245Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:35:06.244Z InvocationID=55aad700-77db-45ba-899e-a4eaafee0f63 LogTimestamp=2021-04-14T13:35:06.245764Z ResponseDesc=OK Exiting. 2021-04-14T13:35:06.245Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:35:08.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8398392b-da2e-4088-bd4b-36e95ea0ad8d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:08.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8398392b-da2e-4088-bd4b-36e95ea0ad8d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3e72f75c 2021-04-14T13:35:08.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8398392b-da2e-4088-bd4b-36e95ea0ad8d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:08.894Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8398392b-da2e-4088-bd4b-36e95ea0ad8d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b016dce-d53b-4516-9a4f-c6b1f949aab4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b016dce-d53b-4516-9a4f-c6b1f949aab4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f1fc0dd 2021-04-14T13:35:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b016dce-d53b-4516-9a4f-c6b1f949aab4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:12.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1b016dce-d53b-4516-9a4f-c6b1f949aab4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:14.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c0145d6-60fb-4cdb-ba64-1664f46e5275 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:14.897Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c0145d6-60fb-4cdb-ba64-1664f46e5275 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3c8e1252 2021-04-14T13:35:14.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c0145d6-60fb-4cdb-ba64-1664f46e5275 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:14.898Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4c0145d6-60fb-4cdb-ba64-1664f46e5275 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:16.195Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:16.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0980f5-b953-4011-b198-e4ccc780c460 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0980f5-b953-4011-b198-e4ccc780c460 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38cd32d9 2021-04-14T13:35:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0980f5-b953-4011-b198-e4ccc780c460 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:18.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3d0980f5-b953-4011-b198-e4ccc780c460 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:20.487Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4779c9e4-9334-41e6-87ed-255da1298f78 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:20.487342Z InvocationID=5d53ad41-3681-4f3e-9fea-7b15342ba0b3 LogTimestamp=2021-04-14T13:35:20.487414Z Entering 2021-04-14T13:35:20.487Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4779c9e4-9334-41e6-87ed-255da1298f78 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:20.487342Z InvocationID=5d53ad41-3681-4f3e-9fea-7b15342ba0b3 LogTimestamp=2021-04-14T13:35:20.487414Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:35:20.490Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:35:20.488Z InvocationID=f26a116c-2513-4b88-ae96-74bb6fdacbb9 LogTimestamp=2021-04-14T13:35:20.490320Z ResponseDesc=OK Exiting. 2021-04-14T13:35:20.490Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:35:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1468bc-177e-49cb-82d1-abe376dca829 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1468bc-177e-49cb-82d1-abe376dca829 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@11acfa8b 2021-04-14T13:35:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1468bc-177e-49cb-82d1-abe376dca829 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:20.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d1468bc-177e-49cb-82d1-abe376dca829 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:24.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3806cc34-5e24-402c-9df0-349a6241b567 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:24.042Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3806cc34-5e24-402c-9df0-349a6241b567 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4064c94b 2021-04-14T13:35:24.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3806cc34-5e24-402c-9df0-349a6241b567 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:24.043Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3806cc34-5e24-402c-9df0-349a6241b567 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:27.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=057d0df4-6e15-4ad6-b48c-ce46ee3ab259 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:27.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=057d0df4-6e15-4ad6-b48c-ce46ee3ab259 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@cb44f97 2021-04-14T13:35:27.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=057d0df4-6e15-4ad6-b48c-ce46ee3ab259 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:27.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=057d0df4-6e15-4ad6-b48c-ce46ee3ab259 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:29.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8246e1-73c8-41e6-a2d1-8b495fe87074 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:29.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8246e1-73c8-41e6-a2d1-8b495fe87074 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d3eef22 2021-04-14T13:35:29.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8246e1-73c8-41e6-a2d1-8b495fe87074 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:29.928Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4e8246e1-73c8-41e6-a2d1-8b495fe87074 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=285cc973-a619-4077-ae6e-d75e682963cb PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=285cc973-a619-4077-ae6e-d75e682963cb PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b302eac 2021-04-14T13:35:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=285cc973-a619-4077-ae6e-d75e682963cb PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:32.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=285cc973-a619-4077-ae6e-d75e682963cb PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:36.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a570c2d-d493-427d-9f5c-b143698653be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:36.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a570c2d-d493-427d-9f5c-b143698653be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4df88410 2021-04-14T13:35:36.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a570c2d-d493-427d-9f5c-b143698653be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:36.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1a570c2d-d493-427d-9f5c-b143698653be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:36.225Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=aee0460e-7b27-491f-9d8e-b1984d48ec9b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:36.225392Z InvocationID=3f613aa6-a643-4f4f-8bc9-dfaec7dd3414 LogTimestamp=2021-04-14T13:35:36.225437Z Entering 2021-04-14T13:35:36.225Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=aee0460e-7b27-491f-9d8e-b1984d48ec9b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:36.225392Z InvocationID=3f613aa6-a643-4f4f-8bc9-dfaec7dd3414 LogTimestamp=2021-04-14T13:35:36.225437Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:35:36.227Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:35:36.226Z InvocationID=e5c1261b-a7dc-41eb-bf45-2331fcbb7f45 LogTimestamp=2021-04-14T13:35:36.227242Z ResponseDesc=OK Exiting. 2021-04-14T13:35:36.227Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:35:38.948Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24856360-89a1-4f48-a5f4-0c5815ad11da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24856360-89a1-4f48-a5f4-0c5815ad11da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@639eb2cf 2021-04-14T13:35:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24856360-89a1-4f48-a5f4-0c5815ad11da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:38.949Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=24856360-89a1-4f48-a5f4-0c5815ad11da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829cb7dd-7b5a-4ee4-b747-7994d91fdc9b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829cb7dd-7b5a-4ee4-b747-7994d91fdc9b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49f31661 2021-04-14T13:35:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829cb7dd-7b5a-4ee4-b747-7994d91fdc9b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:41.542Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=829cb7dd-7b5a-4ee4-b747-7994d91fdc9b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1fca90c-c824-479a-85bc-899db628d7d5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1fca90c-c824-479a-85bc-899db628d7d5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@639c04bd 2021-04-14T13:35:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1fca90c-c824-479a-85bc-899db628d7d5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:45.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e1fca90c-c824-479a-85bc-899db628d7d5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:35:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:35:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9166ae0-d81b-4b6a-9dc3-cbfa92250470 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9166ae0-d81b-4b6a-9dc3-cbfa92250470 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6acdc4da 2021-04-14T13:35:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9166ae0-d81b-4b6a-9dc3-cbfa92250470 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b9166ae0-d81b-4b6a-9dc3-cbfa92250470 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:48.219Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=fbee4971-b8a4-4573-8849-4d940443218b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:48.219212Z InvocationID=7232c582-6650-433d-8095-d8f543d6a404 LogTimestamp=2021-04-14T13:35:48.219285Z Entering 2021-04-14T13:35:48.219Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=fbee4971-b8a4-4573-8849-4d940443218b InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:35:48.219212Z InvocationID=7232c582-6650-433d-8095-d8f543d6a404 LogTimestamp=2021-04-14T13:35:48.219285Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:35:48.221Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:35:48.219Z InvocationID=0420b62d-1104-4e2a-8928-34e6f3005520 LogTimestamp=2021-04-14T13:35:48.221027Z ResponseDesc=OK Exiting. 2021-04-14T13:35:48.221Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:35:51.310Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d42ff8b-0e39-4ba1-aee7-3d89e0313921 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:51.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d42ff8b-0e39-4ba1-aee7-3d89e0313921 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cd30b86 2021-04-14T13:35:51.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d42ff8b-0e39-4ba1-aee7-3d89e0313921 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:51.311Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6d42ff8b-0e39-4ba1-aee7-3d89e0313921 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051e5672-d0eb-4240-a2b6-439f771ee361 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051e5672-d0eb-4240-a2b6-439f771ee361 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2dc25a63 2021-04-14T13:35:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051e5672-d0eb-4240-a2b6-439f771ee361 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=051e5672-d0eb-4240-a2b6-439f771ee361 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a30956-9cf0-4bfd-bc9f-128114085189 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a30956-9cf0-4bfd-bc9f-128114085189 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2e780a8a 2021-04-14T13:35:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a30956-9cf0-4bfd-bc9f-128114085189 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:56.889Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7a30956-9cf0-4bfd-bc9f-128114085189 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:35:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd1a460-1869-4f14-9de8-42f1545efca8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:35:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd1a460-1869-4f14-9de8-42f1545efca8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a97f08b 2021-04-14T13:35:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd1a460-1869-4f14-9de8-42f1545efca8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:35:59.538Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cd1a460-1869-4f14-9de8-42f1545efca8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:01.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:01.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:02.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35ab149-71b1-46ec-b924-2c6d0e0771c9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:02.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35ab149-71b1-46ec-b924-2c6d0e0771c9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4efc4164 2021-04-14T13:36:02.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35ab149-71b1-46ec-b924-2c6d0e0771c9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:02.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d35ab149-71b1-46ec-b924-2c6d0e0771c9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:36:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:36:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:36:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:36:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:36:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:36:06.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc9782f-9a9e-4dcd-a09c-2f699e1157d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:06.023Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc9782f-9a9e-4dcd-a09c-2f699e1157d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@71d20b9a 2021-04-14T13:36:06.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc9782f-9a9e-4dcd-a09c-2f699e1157d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:06.024Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9cc9782f-9a9e-4dcd-a09c-2f699e1157d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:06.239Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c521fc70-fa7f-4095-acb6-083b467bb519 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:36:06.239647Z InvocationID=3088091a-d4b7-4851-90af-cae60362c116 LogTimestamp=2021-04-14T13:36:06.239683Z Entering 2021-04-14T13:36:06.240Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c521fc70-fa7f-4095-acb6-083b467bb519 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:36:06.239647Z InvocationID=3088091a-d4b7-4851-90af-cae60362c116 LogTimestamp=2021-04-14T13:36:06.239683Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:36:06.241Z [qtp580718781-19] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:36:06.240Z InvocationID=72495779-a4b5-4dec-91ee-2571fde971f6 LogTimestamp=2021-04-14T13:36:06.241229Z ResponseDesc=OK Exiting. 2021-04-14T13:36:06.241Z [qtp580718781-19] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:36:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=621ba887-9598-41e5-ad73-b2287e60d6dc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=621ba887-9598-41e5-ad73-b2287e60d6dc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f106370 2021-04-14T13:36:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=621ba887-9598-41e5-ad73-b2287e60d6dc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=621ba887-9598-41e5-ad73-b2287e60d6dc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de93020-df3f-4b1c-b81b-6035887fb625 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de93020-df3f-4b1c-b81b-6035887fb625 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@a96dbb1 2021-04-14T13:36:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de93020-df3f-4b1c-b81b-6035887fb625 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:11.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0de93020-df3f-4b1c-b81b-6035887fb625 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:14.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4697ea1-2c07-40d9-864d-07d711070b38 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:14.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4697ea1-2c07-40d9-864d-07d711070b38 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@264d5ce6 2021-04-14T13:36:14.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4697ea1-2c07-40d9-864d-07d711070b38 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:14.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a4697ea1-2c07-40d9-864d-07d711070b38 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:16.220Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:16.221Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:16.222Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:18.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c682b9-19ef-4b42-a7a6-d3e597c39254 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:18.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c682b9-19ef-4b42-a7a6-d3e597c39254 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@47a21d6e 2021-04-14T13:36:18.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c682b9-19ef-4b42-a7a6-d3e597c39254 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:18.094Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=39c682b9-19ef-4b42-a7a6-d3e597c39254 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:20.527Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c1570f6-f1bb-4de0-9d21-d2b5d06666ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:20.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c1570f6-f1bb-4de0-9d21-d2b5d06666ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5b35ed09 2021-04-14T13:36:20.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c1570f6-f1bb-4de0-9d21-d2b5d06666ca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:20.528Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c1570f6-f1bb-4de0-9d21-d2b5d06666ca PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:24.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d672a8f-1992-4e49-a03d-2dc8f4afc741 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:24.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d672a8f-1992-4e49-a03d-2dc8f4afc741 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6742fe8d 2021-04-14T13:36:24.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d672a8f-1992-4e49-a03d-2dc8f4afc741 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:24.015Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4d672a8f-1992-4e49-a03d-2dc8f4afc741 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:27.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2580dfbb-ca05-4d21-9355-ef016d742a05 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:27.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2580dfbb-ca05-4d21-9355-ef016d742a05 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2b2434ef 2021-04-14T13:36:27.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2580dfbb-ca05-4d21-9355-ef016d742a05 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:27.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2580dfbb-ca05-4d21-9355-ef016d742a05 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:30.121Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1886df76-8ff2-428d-b942-5fe63f697708 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:30.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1886df76-8ff2-428d-b942-5fe63f697708 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cba0588 2021-04-14T13:36:30.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1886df76-8ff2-428d-b942-5fe63f697708 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:30.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1886df76-8ff2-428d-b942-5fe63f697708 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:31.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=354e9926-b8c9-4ab8-8c67-0d4c8326b57b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=354e9926-b8c9-4ab8-8c67-0d4c8326b57b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@813f2b3 2021-04-14T13:36:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=354e9926-b8c9-4ab8-8c67-0d4c8326b57b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:33.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=354e9926-b8c9-4ab8-8c67-0d4c8326b57b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:35.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6067438-c566-4efe-bf7d-0b7003ddd368 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:35.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6067438-c566-4efe-bf7d-0b7003ddd368 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@78d5c3aa 2021-04-14T13:36:35.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6067438-c566-4efe-bf7d-0b7003ddd368 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:35.788Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a6067438-c566-4efe-bf7d-0b7003ddd368 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:36.217Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=aee3a9ba-7c11-48f2-847a-cb2230982427 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:36:36.217033Z InvocationID=3de3425c-3bb7-4401-886d-556e91cebae5 LogTimestamp=2021-04-14T13:36:36.217118Z Entering 2021-04-14T13:36:36.217Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=aee3a9ba-7c11-48f2-847a-cb2230982427 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:36:36.217033Z InvocationID=3de3425c-3bb7-4401-886d-556e91cebae5 LogTimestamp=2021-04-14T13:36:36.217118Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:36:36.219Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:36:36.217Z InvocationID=144d7d5d-2393-4038-98f3-8732f44bf556 LogTimestamp=2021-04-14T13:36:36.219772Z ResponseDesc=OK Exiting. 2021-04-14T13:36:36.219Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:36:39.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7565bcc-d6cc-4a05-9cc9-fd9d5f3bf240 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:39.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7565bcc-d6cc-4a05-9cc9-fd9d5f3bf240 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@72dc1313 2021-04-14T13:36:39.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7565bcc-d6cc-4a05-9cc9-fd9d5f3bf240 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:39.135Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b7565bcc-d6cc-4a05-9cc9-fd9d5f3bf240 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d526748c-02cf-41b0-b40b-028f883335e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d526748c-02cf-41b0-b40b-028f883335e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ee6ce85 2021-04-14T13:36:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d526748c-02cf-41b0-b40b-028f883335e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:41.554Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d526748c-02cf-41b0-b40b-028f883335e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0140bb31-c7a2-4b73-acf4-9837bbfbb516 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0140bb31-c7a2-4b73-acf4-9837bbfbb516 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49773980 2021-04-14T13:36:45.127Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0140bb31-c7a2-4b73-acf4-9837bbfbb516 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:45.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0140bb31-c7a2-4b73-acf4-9837bbfbb516 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:46.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:36:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:36:47.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9c181d9-c556-4fd1-adf1-29a91eda8870 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:47.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9c181d9-c556-4fd1-adf1-29a91eda8870 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1fe97b97 2021-04-14T13:36:47.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9c181d9-c556-4fd1-adf1-29a91eda8870 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:47.708Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f9c181d9-c556-4fd1-adf1-29a91eda8870 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec2387d-157d-4887-9689-752854c0bf04 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec2387d-157d-4887-9689-752854c0bf04 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@d3fa7f2 2021-04-14T13:36:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec2387d-157d-4887-9689-752854c0bf04 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:51.222Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cec2387d-157d-4887-9689-752854c0bf04 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:54.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94841f88-0a54-4006-b51e-d1774e030763 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:54.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94841f88-0a54-4006-b51e-d1774e030763 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6545d236 2021-04-14T13:36:54.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94841f88-0a54-4006-b51e-d1774e030763 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:54.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=94841f88-0a54-4006-b51e-d1774e030763 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b968af1-462a-4a40-b6d9-c8fb36c29c74 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b968af1-462a-4a40-b6d9-c8fb36c29c74 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@158e4c27 2021-04-14T13:36:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b968af1-462a-4a40-b6d9-c8fb36c29c74 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:56.929Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3b968af1-462a-4a40-b6d9-c8fb36c29c74 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:36:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e4971-d697-4b62-8fb6-38dd2b6a30ec PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:36:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e4971-d697-4b62-8fb6-38dd2b6a30ec PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@416fa8c2 2021-04-14T13:36:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e4971-d697-4b62-8fb6-38dd2b6a30ec PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:36:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=032e4971-d697-4b62-8fb6-38dd2b6a30ec PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00927a98-a061-4e34-be8b-b33080beca18 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00927a98-a061-4e34-be8b-b33080beca18 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@319f972a 2021-04-14T13:37:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00927a98-a061-4e34-be8b-b33080beca18 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:02.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=00927a98-a061-4e34-be8b-b33080beca18 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:37:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:37:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:37:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:37:04.356Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:37:04.357Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:37:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71dd367c-b9aa-4d6b-8537-195cd1c43afa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71dd367c-b9aa-4d6b-8537-195cd1c43afa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a80374d 2021-04-14T13:37:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71dd367c-b9aa-4d6b-8537-195cd1c43afa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:06.213Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=71dd367c-b9aa-4d6b-8537-195cd1c43afa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:06.231Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=95e42d36-2314-45de-966f-4d2f87c0eec6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:06.231691Z InvocationID=86889bdb-b40c-49bb-bf9d-1ab02184acc5 LogTimestamp=2021-04-14T13:37:06.231741Z Entering 2021-04-14T13:37:06.232Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=95e42d36-2314-45de-966f-4d2f87c0eec6 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:06.231691Z InvocationID=86889bdb-b40c-49bb-bf9d-1ab02184acc5 LogTimestamp=2021-04-14T13:37:06.231741Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:37:06.233Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:37:06.232Z InvocationID=05b36031-762d-4009-901f-095069aa10cf LogTimestamp=2021-04-14T13:37:06.233347Z ResponseDesc=OK Exiting. 2021-04-14T13:37:06.233Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:37:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e530404-9b72-4012-843a-1ff54765b738 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e530404-9b72-4012-843a-1ff54765b738 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1d88a34e 2021-04-14T13:37:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e530404-9b72-4012-843a-1ff54765b738 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e530404-9b72-4012-843a-1ff54765b738 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:11.835Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4529d0e9-fdac-451a-a224-12e48a94b0b9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:11.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4529d0e9-fdac-451a-a224-12e48a94b0b9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@219d2185 2021-04-14T13:37:11.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4529d0e9-fdac-451a-a224-12e48a94b0b9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:11.836Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4529d0e9-fdac-451a-a224-12e48a94b0b9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1cb1048-a514-4ced-be53-0adcaa42c1f4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1cb1048-a514-4ced-be53-0adcaa42c1f4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6cf6d45b 2021-04-14T13:37:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1cb1048-a514-4ced-be53-0adcaa42c1f4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:14.804Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c1cb1048-a514-4ced-be53-0adcaa42c1f4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:16.198Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:16.199Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:16.200Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:18.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb8a58c2-c35c-4342-98de-b3851783e8b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:18.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb8a58c2-c35c-4342-98de-b3851783e8b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@17b7acd7 2021-04-14T13:37:18.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb8a58c2-c35c-4342-98de-b3851783e8b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:18.091Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fb8a58c2-c35c-4342-98de-b3851783e8b8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b393c870-523e-4d9f-af44-05636bcaa3c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b393c870-523e-4d9f-af44-05636bcaa3c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ffdffbc 2021-04-14T13:37:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b393c870-523e-4d9f-af44-05636bcaa3c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:20.891Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b393c870-523e-4d9f-af44-05636bcaa3c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea4f0fe8-cfd9-4445-885b-992fd1a4a7a1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea4f0fe8-cfd9-4445-885b-992fd1a4a7a1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7246ecf 2021-04-14T13:37:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea4f0fe8-cfd9-4445-885b-992fd1a4a7a1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ea4f0fe8-cfd9-4445-885b-992fd1a4a7a1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc957144-2a6b-40a6-836a-93b660c1a361 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc957144-2a6b-40a6-836a-93b660c1a361 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5d2a367c 2021-04-14T13:37:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc957144-2a6b-40a6-836a-93b660c1a361 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:27.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dc957144-2a6b-40a6-836a-93b660c1a361 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:30.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e74579-48c8-4643-b0ac-c46c358199e3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:30.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e74579-48c8-4643-b0ac-c46c358199e3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77d1f81a 2021-04-14T13:37:30.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e74579-48c8-4643-b0ac-c46c358199e3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:30.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d0e74579-48c8-4643-b0ac-c46c358199e3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a5b8646-3ce2-498d-82ec-8aa9b697a253 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a5b8646-3ce2-498d-82ec-8aa9b697a253 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5771e943 2021-04-14T13:37:33.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a5b8646-3ce2-498d-82ec-8aa9b697a253 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:33.123Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a5b8646-3ce2-498d-82ec-8aa9b697a253 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a368a44f-a8bf-4986-9fcd-6036ac65ee0a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a368a44f-a8bf-4986-9fcd-6036ac65ee0a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7307b774 2021-04-14T13:37:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a368a44f-a8bf-4986-9fcd-6036ac65ee0a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:36.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a368a44f-a8bf-4986-9fcd-6036ac65ee0a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:36.227Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=1f3a459b-c484-42aa-a257-a43ab4639b19 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:36.227280Z InvocationID=9eb0538e-730a-4ccd-9729-66617ca1de96 LogTimestamp=2021-04-14T13:37:36.227336Z Entering 2021-04-14T13:37:36.227Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=1f3a459b-c484-42aa-a257-a43ab4639b19 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:36.227280Z InvocationID=9eb0538e-730a-4ccd-9729-66617ca1de96 LogTimestamp=2021-04-14T13:37:36.227336Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:37:36.228Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:37:36.227Z InvocationID=1e99bd13-607a-4a92-a9a4-e69b3e351a76 LogTimestamp=2021-04-14T13:37:36.228682Z ResponseDesc=OK Exiting. 2021-04-14T13:37:36.228Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:37:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b67fc1a3-e482-46c5-9977-bde6b39dea41 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b67fc1a3-e482-46c5-9977-bde6b39dea41 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7f92e6be 2021-04-14T13:37:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b67fc1a3-e482-46c5-9977-bde6b39dea41 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b67fc1a3-e482-46c5-9977-bde6b39dea41 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1228b0cb-8583-48cd-9e9f-970d8b7ba8f5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1228b0cb-8583-48cd-9e9f-970d8b7ba8f5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77bc07e 2021-04-14T13:37:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1228b0cb-8583-48cd-9e9f-970d8b7ba8f5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:41.561Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=1228b0cb-8583-48cd-9e9f-970d8b7ba8f5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7617d93f-584d-45d4-bb45-703a47abe04a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7617d93f-584d-45d4-bb45-703a47abe04a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5f180a23 2021-04-14T13:37:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7617d93f-584d-45d4-bb45-703a47abe04a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:44.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7617d93f-584d-45d4-bb45-703a47abe04a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:46.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:37:46.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:37:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9502e38-afc5-40e8-b49f-588a3908dc11 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9502e38-afc5-40e8-b49f-588a3908dc11 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@116aaaa3 2021-04-14T13:37:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9502e38-afc5-40e8-b49f-588a3908dc11 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:48.000Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a9502e38-afc5-40e8-b49f-588a3908dc11 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:48.221Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c1e7ec39-4b6c-470f-886a-43d343204db0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:48.221686Z InvocationID=9c858577-cc30-48e1-b7a0-7afc1b504cd4 LogTimestamp=2021-04-14T13:37:48.221733Z Entering 2021-04-14T13:37:48.222Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c1e7ec39-4b6c-470f-886a-43d343204db0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:48.221686Z InvocationID=9c858577-cc30-48e1-b7a0-7afc1b504cd4 LogTimestamp=2021-04-14T13:37:48.221733Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:37:48.222Z [qtp580718781-12] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:37:48.222Z InvocationID=ff1f8c37-bb89-4217-a456-f8e9383ef72d LogTimestamp=2021-04-14T13:37:48.222911Z ResponseDesc=OK Exiting. 2021-04-14T13:37:48.223Z [qtp580718781-12] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:37:51.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807f0106-8405-471a-8fa0-00a1093cca4e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:51.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807f0106-8405-471a-8fa0-00a1093cca4e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@79a50926 2021-04-14T13:37:51.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807f0106-8405-471a-8fa0-00a1093cca4e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:51.212Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=807f0106-8405-471a-8fa0-00a1093cca4e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0714dc95-8426-47f3-bf8b-222163072072 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0714dc95-8426-47f3-bf8b-222163072072 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@20045e5c 2021-04-14T13:37:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0714dc95-8426-47f3-bf8b-222163072072 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:54.037Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0714dc95-8426-47f3-bf8b-222163072072 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:55.871Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=e446197f-1778-4de7-85ea-85d861d2a02e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:55.871453Z InvocationID=fe6e52e3-01e4-4f2b-8dbf-3ad6cde1e521 LogTimestamp=2021-04-14T13:37:55.871481Z Entering 2021-04-14T13:37:55.871Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=e446197f-1778-4de7-85ea-85d861d2a02e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:37:55.871453Z InvocationID=fe6e52e3-01e4-4f2b-8dbf-3ad6cde1e521 LogTimestamp=2021-04-14T13:37:55.871481Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:37:55.872Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:37:55.871Z InvocationID=eb2fcfe6-2a39-4d6e-90b6-eeff0ec73e70 LogTimestamp=2021-04-14T13:37:55.872850Z ResponseDesc=OK Exiting. 2021-04-14T13:37:55.873Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:37:57.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea1bda6-3e95-4689-a523-e076a0b1b480 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:57.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea1bda6-3e95-4689-a523-e076a0b1b480 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3fd2016d 2021-04-14T13:37:57.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea1bda6-3e95-4689-a523-e076a0b1b480 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:57.051Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=aea1bda6-3e95-4689-a523-e076a0b1b480 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:37:59.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5766d3aa-6fdd-4dea-b7b1-f8bb627f38c3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:37:59.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5766d3aa-6fdd-4dea-b7b1-f8bb627f38c3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7b299b86 2021-04-14T13:37:59.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5766d3aa-6fdd-4dea-b7b1-f8bb627f38c3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:37:59.531Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5766d3aa-6fdd-4dea-b7b1-f8bb627f38c3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:01.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:01.188Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:01.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:02.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dae6e0fe-732d-4de9-851e-9742b78b72e1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:02.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dae6e0fe-732d-4de9-851e-9742b78b72e1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a1441fc 2021-04-14T13:38:02.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dae6e0fe-732d-4de9-851e-9742b78b72e1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:02.832Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=dae6e0fe-732d-4de9-851e-9742b78b72e1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:38:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:38:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:38:04.352Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:38:04.355Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:04.355Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:38:04.356Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:38:06.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=192269b9-fc25-43eb-aa1d-bb2eeb360e7a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:06.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=192269b9-fc25-43eb-aa1d-bb2eeb360e7a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28e01c5c 2021-04-14T13:38:06.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=192269b9-fc25-43eb-aa1d-bb2eeb360e7a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:06.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=192269b9-fc25-43eb-aa1d-bb2eeb360e7a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:06.235Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=bfeb411e-6d6a-45d7-9af7-d0cad5e728a8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:38:06.235038Z InvocationID=37719181-c23b-4697-98b7-3910a89882a4 LogTimestamp=2021-04-14T13:38:06.235104Z Entering 2021-04-14T13:38:06.235Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=bfeb411e-6d6a-45d7-9af7-d0cad5e728a8 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:38:06.235038Z InvocationID=37719181-c23b-4697-98b7-3910a89882a4 LogTimestamp=2021-04-14T13:38:06.235104Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:38:06.236Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:38:06.235Z InvocationID=176a5df9-9f9b-4ae7-95b6-0ec9303b35fd LogTimestamp=2021-04-14T13:38:06.236712Z ResponseDesc=OK Exiting. 2021-04-14T13:38:06.237Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:38:09.081Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6989314a-a74b-4a7a-8927-f9b5371adbd9 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6989314a-a74b-4a7a-8927-f9b5371adbd9 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@716b944 2021-04-14T13:38:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6989314a-a74b-4a7a-8927-f9b5371adbd9 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:09.082Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6989314a-a74b-4a7a-8927-f9b5371adbd9 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365fbe80-209c-425d-9d06-663532940469 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365fbe80-209c-425d-9d06-663532940469 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@30d4f78b 2021-04-14T13:38:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365fbe80-209c-425d-9d06-663532940469 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:12.014Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365fbe80-209c-425d-9d06-663532940469 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:14.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e06c3301-459e-4ddd-b2cd-4eb743946831 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:14.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e06c3301-459e-4ddd-b2cd-4eb743946831 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@38c75bcc 2021-04-14T13:38:14.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e06c3301-459e-4ddd-b2cd-4eb743946831 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:14.723Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e06c3301-459e-4ddd-b2cd-4eb743946831 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:16.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:16.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8641fb94-e9b8-43a4-b9e1-9d229eedbbcc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8641fb94-e9b8-43a4-b9e1-9d229eedbbcc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@106db274 2021-04-14T13:38:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8641fb94-e9b8-43a4-b9e1-9d229eedbbcc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:18.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8641fb94-e9b8-43a4-b9e1-9d229eedbbcc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:20.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88acc514-25d5-45cb-8c29-345db399c3ef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:20.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88acc514-25d5-45cb-8c29-345db399c3ef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2283f5a4 2021-04-14T13:38:20.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88acc514-25d5-45cb-8c29-345db399c3ef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:20.532Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=88acc514-25d5-45cb-8c29-345db399c3ef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e401611f-071a-472e-bde5-80480e045c69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e401611f-071a-472e-bde5-80480e045c69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35fc36d0 2021-04-14T13:38:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e401611f-071a-472e-bde5-80480e045c69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:24.033Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e401611f-071a-472e-bde5-80480e045c69 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b17b097-f3c0-4b54-9f19-68c6ec01686c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b17b097-f3c0-4b54-9f19-68c6ec01686c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@37671298 2021-04-14T13:38:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b17b097-f3c0-4b54-9f19-68c6ec01686c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5b17b097-f3c0-4b54-9f19-68c6ec01686c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a35c14-dcc5-4da4-b8dc-562b3d0d0247 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a35c14-dcc5-4da4-b8dc-562b3d0d0247 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4ae4e812 2021-04-14T13:38:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a35c14-dcc5-4da4-b8dc-562b3d0d0247 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:29.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=04a35c14-dcc5-4da4-b8dc-562b3d0d0247 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:31.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dda3e0-fe87-428c-8fc4-fd746a307b5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dda3e0-fe87-428c-8fc4-fd746a307b5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@77f70a3f 2021-04-14T13:38:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dda3e0-fe87-428c-8fc4-fd746a307b5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38dda3e0-fe87-428c-8fc4-fd746a307b5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c28fe08-d4a0-4b0d-a480-428cd836bc34 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c28fe08-d4a0-4b0d-a480-428cd836bc34 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2369e8a7 2021-04-14T13:38:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c28fe08-d4a0-4b0d-a480-428cd836bc34 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:35.887Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6c28fe08-d4a0-4b0d-a480-428cd836bc34 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:36.233Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=44d66728-a7a7-42e5-a820-06e92b628e17 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:38:36.232551Z InvocationID=d353dd7c-ad05-40ca-99bc-c3e03e05c343 LogTimestamp=2021-04-14T13:38:36.232655Z Entering 2021-04-14T13:38:36.233Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=44d66728-a7a7-42e5-a820-06e92b628e17 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:38:36.232551Z InvocationID=d353dd7c-ad05-40ca-99bc-c3e03e05c343 LogTimestamp=2021-04-14T13:38:36.232655Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:38:36.236Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:38:36.233Z InvocationID=22a6d09c-ef9a-42c5-98f6-a91a7e93d3c6 LogTimestamp=2021-04-14T13:38:36.235921Z ResponseDesc=OK Exiting. 2021-04-14T13:38:36.236Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:38:39.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bdfe75d-e4c2-44d1-9365-80dcca4e010f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:39.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bdfe75d-e4c2-44d1-9365-80dcca4e010f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2c15cd80 2021-04-14T13:38:39.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bdfe75d-e4c2-44d1-9365-80dcca4e010f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:39.030Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=8bdfe75d-e4c2-44d1-9365-80dcca4e010f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=861d1e9a-0fe9-45ba-bb41-cbd4ff6eeafa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=861d1e9a-0fe9-45ba-bb41-cbd4ff6eeafa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@415c0468 2021-04-14T13:38:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=861d1e9a-0fe9-45ba-bb41-cbd4ff6eeafa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:41.592Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=861d1e9a-0fe9-45ba-bb41-cbd4ff6eeafa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:44.922Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad12c85b-1171-455c-8993-74b270c16159 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:44.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad12c85b-1171-455c-8993-74b270c16159 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@eb5588e 2021-04-14T13:38:44.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad12c85b-1171-455c-8993-74b270c16159 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:44.923Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ad12c85b-1171-455c-8993-74b270c16159 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:46.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:46.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:38:46.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:38:47.706Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360cdea2-79d1-4bd4-9503-18121aecde44 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:47.706Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360cdea2-79d1-4bd4-9503-18121aecde44 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62f5a52f 2021-04-14T13:38:47.706Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360cdea2-79d1-4bd4-9503-18121aecde44 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:47.706Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=360cdea2-79d1-4bd4-9503-18121aecde44 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b14b09a-0e9d-489a-a32e-563328e44731 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b14b09a-0e9d-489a-a32e-563328e44731 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@608e1d3c 2021-04-14T13:38:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b14b09a-0e9d-489a-a32e-563328e44731 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:51.229Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b14b09a-0e9d-489a-a32e-563328e44731 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365972dd-d162-4142-82d4-1f164b965597 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365972dd-d162-4142-82d4-1f164b965597 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@41502a01 2021-04-14T13:38:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365972dd-d162-4142-82d4-1f164b965597 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:53.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=365972dd-d162-4142-82d4-1f164b965597 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d8177ef-2dce-4f3d-8292-518fc7a579ea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d8177ef-2dce-4f3d-8292-518fc7a579ea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@65856b8d 2021-04-14T13:38:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d8177ef-2dce-4f3d-8292-518fc7a579ea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:57.044Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0d8177ef-2dce-4f3d-8292-518fc7a579ea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:38:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d73213a4-0d5b-4b08-8035-15476a7f1c65 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:38:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d73213a4-0d5b-4b08-8035-15476a7f1c65 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2a9666cf 2021-04-14T13:38:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d73213a4-0d5b-4b08-8035-15476a7f1c65 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:38:59.733Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=d73213a4-0d5b-4b08-8035-15476a7f1c65 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:01.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:01.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49fdba64-4703-4635-b372-660747931dcc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49fdba64-4703-4635-b372-660747931dcc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3ae1e95c 2021-04-14T13:39:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49fdba64-4703-4635-b372-660747931dcc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:02.917Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=49fdba64-4703-4635-b372-660747931dcc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:39:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:39:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:39:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:39:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:39:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:39:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a441861d-0413-4406-bd25-ee583d269624 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a441861d-0413-4406-bd25-ee583d269624 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7aa1dc23 2021-04-14T13:39:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a441861d-0413-4406-bd25-ee583d269624 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:06.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=a441861d-0413-4406-bd25-ee583d269624 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:06.236Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=f4f0d0d9-1a6b-409a-9c54-e124ee0c5e7c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:39:06.236067Z InvocationID=13f2ef0d-e0ba-4f4d-a904-0ddfad7cc2ae LogTimestamp=2021-04-14T13:39:06.236129Z Entering 2021-04-14T13:39:06.236Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=f4f0d0d9-1a6b-409a-9c54-e124ee0c5e7c InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:39:06.236067Z InvocationID=13f2ef0d-e0ba-4f4d-a904-0ddfad7cc2ae LogTimestamp=2021-04-14T13:39:06.236129Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:39:06.238Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:39:06.236Z InvocationID=28d1af6d-fea2-4670-963c-48f234769f9f LogTimestamp=2021-04-14T13:39:06.238033Z ResponseDesc=OK Exiting. 2021-04-14T13:39:06.238Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:39:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284e8f64-bc5b-4109-9ac5-273c1cbe23d4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284e8f64-bc5b-4109-9ac5-273c1cbe23d4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@343619f9 2021-04-14T13:39:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284e8f64-bc5b-4109-9ac5-273c1cbe23d4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:08.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=284e8f64-bc5b-4109-9ac5-273c1cbe23d4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d413749-5151-445f-ac18-cccbae04c591 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d413749-5151-445f-ac18-cccbae04c591 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d8fb1ae 2021-04-14T13:39:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d413749-5151-445f-ac18-cccbae04c591 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:12.111Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2d413749-5151-445f-ac18-cccbae04c591 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:14.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27964d84-5269-494b-8584-52b777d7130f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:14.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27964d84-5269-494b-8584-52b777d7130f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1891064a 2021-04-14T13:39:14.711Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27964d84-5269-494b-8584-52b777d7130f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:14.712Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=27964d84-5269-494b-8584-52b777d7130f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:16.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:16.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:16.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:16.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:17.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81eb20ca-ba1b-4c77-8ed0-e1b48d2e500e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:17.987Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81eb20ca-ba1b-4c77-8ed0-e1b48d2e500e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c2581bf 2021-04-14T13:39:17.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81eb20ca-ba1b-4c77-8ed0-e1b48d2e500e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:17.988Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=81eb20ca-ba1b-4c77-8ed0-e1b48d2e500e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:20.589Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f624d288-bfb8-4324-9e0c-ea6a4f36c85a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f624d288-bfb8-4324-9e0c-ea6a4f36c85a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d8b413 2021-04-14T13:39:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f624d288-bfb8-4324-9e0c-ea6a4f36c85a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:20.590Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f624d288-bfb8-4324-9e0c-ea6a4f36c85a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c26eae4-ef32-4ff2-804f-174c8817fe23 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c26eae4-ef32-4ff2-804f-174c8817fe23 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@380a6a67 2021-04-14T13:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c26eae4-ef32-4ff2-804f-174c8817fe23 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:24.028Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2c26eae4-ef32-4ff2-804f-174c8817fe23 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee8cd06-8d80-48bb-a579-6b4a4f4ec688 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee8cd06-8d80-48bb-a579-6b4a4f4ec688 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2839987a 2021-04-14T13:39:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee8cd06-8d80-48bb-a579-6b4a4f4ec688 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:27.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=2ee8cd06-8d80-48bb-a579-6b4a4f4ec688 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:29.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db9e31ff-c6b8-4ca2-a8bd-e737dd900da3 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:29.818Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db9e31ff-c6b8-4ca2-a8bd-e737dd900da3 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@68d1dcbb 2021-04-14T13:39:29.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db9e31ff-c6b8-4ca2-a8bd-e737dd900da3 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:29.819Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=db9e31ff-c6b8-4ca2-a8bd-e737dd900da3 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:31.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:31.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0979c297-5935-4b01-b3f2-2acbd2df08e4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0979c297-5935-4b01-b3f2-2acbd2df08e4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4584859e 2021-04-14T13:39:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0979c297-5935-4b01-b3f2-2acbd2df08e4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:33.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0979c297-5935-4b01-b3f2-2acbd2df08e4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ead81c-76dc-45a8-b758-cbfaae1ed75a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ead81c-76dc-45a8-b758-cbfaae1ed75a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2eb6861b 2021-04-14T13:39:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ead81c-76dc-45a8-b758-cbfaae1ed75a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:35.882Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=08ead81c-76dc-45a8-b758-cbfaae1ed75a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:36.240Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=6e30f6ac-9c8c-46ee-8699-0d77b5abe820 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:39:36.240309Z InvocationID=15758491-f570-4467-9998-40f94d15bb99 LogTimestamp=2021-04-14T13:39:36.240368Z Entering 2021-04-14T13:39:36.240Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=6e30f6ac-9c8c-46ee-8699-0d77b5abe820 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:39:36.240309Z InvocationID=15758491-f570-4467-9998-40f94d15bb99 LogTimestamp=2021-04-14T13:39:36.240368Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:39:36.241Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:39:36.240Z InvocationID=4589eb09-94f8-46b7-b197-3ae9e1096114 LogTimestamp=2021-04-14T13:39:36.241774Z ResponseDesc=OK Exiting. 2021-04-14T13:39:36.242Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:39:39.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f386193a-b8e4-4b47-ade2-27b4ef836fd6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:39.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f386193a-b8e4-4b47-ade2-27b4ef836fd6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a2831ff 2021-04-14T13:39:39.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f386193a-b8e4-4b47-ade2-27b4ef836fd6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:39.128Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f386193a-b8e4-4b47-ade2-27b4ef836fd6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7b8a271-bfb2-4d40-b1f1-7ed4f141649b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7b8a271-bfb2-4d40-b1f1-7ed4f141649b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2cfa0805 2021-04-14T13:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7b8a271-bfb2-4d40-b1f1-7ed4f141649b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:41.546Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7b8a271-bfb2-4d40-b1f1-7ed4f141649b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:45.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dae9873-5265-42b5-b2eb-b5cada047fc7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:45.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dae9873-5265-42b5-b2eb-b5cada047fc7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4d33c071 2021-04-14T13:39:45.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dae9873-5265-42b5-b2eb-b5cada047fc7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:45.117Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3dae9873-5265-42b5-b2eb-b5cada047fc7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:46.195Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:46.196Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:39:46.197Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:39:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60ecaca9-fd7d-43ae-ac2e-8cf7c5228d5f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60ecaca9-fd7d-43ae-ac2e-8cf7c5228d5f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@572f0192 2021-04-14T13:39:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60ecaca9-fd7d-43ae-ac2e-8cf7c5228d5f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:47.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=60ecaca9-fd7d-43ae-ac2e-8cf7c5228d5f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:48.222Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=c452a815-982b-42ef-9aa8-39d9836d8909 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:39:48.222225Z InvocationID=0bcecd06-cc1d-411a-8332-1be85447e35a LogTimestamp=2021-04-14T13:39:48.222266Z Entering 2021-04-14T13:39:48.222Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=c452a815-982b-42ef-9aa8-39d9836d8909 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:39:48.222225Z InvocationID=0bcecd06-cc1d-411a-8332-1be85447e35a LogTimestamp=2021-04-14T13:39:48.222266Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:39:48.224Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:39:48.222Z InvocationID=1e48d91b-9847-4479-92f3-58776638a59e LogTimestamp=2021-04-14T13:39:48.224472Z ResponseDesc=OK Exiting. 2021-04-14T13:39:48.224Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:39:51.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e55153c-f6e1-47b8-ae39-6591d838e8da PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:51.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e55153c-f6e1-47b8-ae39-6591d838e8da PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c836541 2021-04-14T13:39:51.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e55153c-f6e1-47b8-ae39-6591d838e8da PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:51.120Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6e55153c-f6e1-47b8-ae39-6591d838e8da PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:53.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e5a0bfc-aab1-4025-9a2a-789a5df19932 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:53.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e5a0bfc-aab1-4025-9a2a-789a5df19932 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2045f4f4 2021-04-14T13:39:53.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e5a0bfc-aab1-4025-9a2a-789a5df19932 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:53.843Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0e5a0bfc-aab1-4025-9a2a-789a5df19932 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe46174c-2d46-4ef1-9764-4cc4f93bd99f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe46174c-2d46-4ef1-9764-4cc4f93bd99f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@732688c5 2021-04-14T13:39:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe46174c-2d46-4ef1-9764-4cc4f93bd99f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:56.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fe46174c-2d46-4ef1-9764-4cc4f93bd99f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:39:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e4cd478-e603-4ba4-9a14-d1baf0627505 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:39:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e4cd478-e603-4ba4-9a14-d1baf0627505 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5c2a34a2 2021-04-14T13:39:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e4cd478-e603-4ba4-9a14-d1baf0627505 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:39:59.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9e4cd478-e603-4ba4-9a14-d1baf0627505 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:01.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:01.960Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=b990bc15-857a-409f-9a37-cb6d67e4e5d0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:40:01.960105Z InvocationID=5fefef1e-0de0-46e8-b029-11fa050ad873 LogTimestamp=2021-04-14T13:40:01.960142Z Entering 2021-04-14T13:40:01.960Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=b990bc15-857a-409f-9a37-cb6d67e4e5d0 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServiceName=v1/artifactTypes ServerIPAddress=10.242.62.146 ServiceInstanceID=null EntryTimestamp=2021-04-14T13:40:01.960105Z InvocationID=5fefef1e-0de0-46e8-b029-11fa050ad873 LogTimestamp=2021-04-14T13:40:01.960142Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:40:01.961Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:40:01.960Z InvocationID=230cfab5-f006-484c-98c5-e25b937c9f8f LogTimestamp=2021-04-14T13:40:01.961686Z ResponseDesc=OK Exiting. 2021-04-14T13:40:01.961Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:40:02.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eee9130-cd36-42ef-867c-e39da648a8b8 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:02.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eee9130-cd36-42ef-867c-e39da648a8b8 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1bc4fb0b 2021-04-14T13:40:02.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eee9130-cd36-42ef-867c-e39da648a8b8 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:02.814Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7eee9130-cd36-42ef-867c-e39da648a8b8 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:40:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:40:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:40:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:40:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:40:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:40:06.213Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=defaddec-9105-4f36-839f-c49e67930cad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:40:06.213076Z InvocationID=a04ec8ed-0a08-4ca5-9b8c-ccfdba370866 LogTimestamp=2021-04-14T13:40:06.213106Z Entering 2021-04-14T13:40:06.213Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=defaddec-9105-4f36-839f-c49e67930cad InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:40:06.213076Z InvocationID=a04ec8ed-0a08-4ca5-9b8c-ccfdba370866 LogTimestamp=2021-04-14T13:40:06.213106Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:40:06.214Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:40:06.213Z InvocationID=a2b1eede-b4b7-45e1-9e58-47a282129ea7 LogTimestamp=2021-04-14T13:40:06.214076Z ResponseDesc=OK Exiting. 2021-04-14T13:40:06.214Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:40:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ac281c-6eac-4b01-bb09-168258979432 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ac281c-6eac-4b01-bb09-168258979432 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14294ed3 2021-04-14T13:40:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ac281c-6eac-4b01-bb09-168258979432 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:06.484Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=50ac281c-6eac-4b01-bb09-168258979432 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dd488-8da2-4790-a160-0bf9543ac2fc PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dd488-8da2-4790-a160-0bf9543ac2fc PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@530e8c33 2021-04-14T13:40:09.182Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dd488-8da2-4790-a160-0bf9543ac2fc PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:09.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c65dd488-8da2-4790-a160-0bf9543ac2fc PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2575d4-9461-413c-99a5-48b4089c3614 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2575d4-9461-413c-99a5-48b4089c3614 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5e8c2dd4 2021-04-14T13:40:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2575d4-9461-413c-99a5-48b4089c3614 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:12.119Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=cb2575d4-9461-413c-99a5-48b4089c3614 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:14.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98e5a671-6f10-41c6-b325-cea50e8195ca PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:14.785Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98e5a671-6f10-41c6-b325-cea50e8195ca PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@62ac99ad 2021-04-14T13:40:14.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98e5a671-6f10-41c6-b325-cea50e8195ca PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:14.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=98e5a671-6f10-41c6-b325-cea50e8195ca PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:16.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c055d2-e3d3-4538-b07b-46d2b17435c6 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:17.884Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c055d2-e3d3-4538-b07b-46d2b17435c6 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3cad1cfd 2021-04-14T13:40:17.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c055d2-e3d3-4538-b07b-46d2b17435c6 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:17.885Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b6c055d2-e3d3-4538-b07b-46d2b17435c6 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebc068fd-ac7f-4c36-96f6-cc6040d5a741 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebc068fd-ac7f-4c36-96f6-cc6040d5a741 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1be5604f 2021-04-14T13:40:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebc068fd-ac7f-4c36-96f6-cc6040d5a741 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ebc068fd-ac7f-4c36-96f6-cc6040d5a741 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:23.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed8be87-da00-42f1-998a-95619ca69083 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:23.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed8be87-da00-42f1-998a-95619ca69083 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@24380c6a 2021-04-14T13:40:23.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed8be87-da00-42f1-998a-95619ca69083 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:23.930Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fed8be87-da00-42f1-998a-95619ca69083 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:27.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043e06f5-0113-4532-b7a5-b379f38d52ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:27.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043e06f5-0113-4532-b7a5-b379f38d52ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@225f98b1 2021-04-14T13:40:27.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043e06f5-0113-4532-b7a5-b379f38d52ff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:27.040Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=043e06f5-0113-4532-b7a5-b379f38d52ff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99450244-8c8c-41bb-a924-719c83830689 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99450244-8c8c-41bb-a924-719c83830689 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@764122f3 2021-04-14T13:40:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99450244-8c8c-41bb-a924-719c83830689 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:29.918Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=99450244-8c8c-41bb-a924-719c83830689 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:31.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:31.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:31.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:33.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3982127f-008c-4743-b3ab-e966736b3f14 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:33.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3982127f-008c-4743-b3ab-e966736b3f14 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4696d36c 2021-04-14T13:40:33.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3982127f-008c-4743-b3ab-e966736b3f14 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:33.118Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3982127f-008c-4743-b3ab-e966736b3f14 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node016lx7keufz0nyw4jttcoildcb555 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ajnx0c6ldh0vt5kynzu9g0h6527 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01uhhd9dgg5a611wky30txnrpc0549 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u70l9ik2qy4euxtqw8m94rz9547 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0e00bfpi0otf91xn0hfc4udgxr553 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gf57v69hy04c19rdrjt031tgg532 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qv767uuozdr1184ljt904mch5551 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01fd4dlutqxxgx1w5tadw1a6wti557 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01r0a90xxnqh0m1xbd8t7zcp14x525 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node013e8evwsrs8svc0jsys1cb3c0542 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0unlv7j0w3s5r6vebtpt5zxq5529 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node039z9d05524cw1w40eleqg4xng544 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node011hx22pta8f5sb6enk0p4diio540 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01kjnbskxglkqcgg1db1lofjj4545 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node018tk1kicya9q71c0np076lxry9543 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0y6cmba91f769pmm13yqweedz541 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0u0j6nltc6qfwci8u7qbp2ww2522 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01363vc8cxbo9gbbs684edel7q548 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0b31cd36p0pn917uyafvrdg3tc533 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0q0uvkrqc539mipd70p72p5jv556 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ng1xriv5vzvb13bjp9vgqibua539 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0tecf4emuvliadxbc51prjjzg531 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01gqzsqg1r31lh6f51tcyb7935546 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0bc0dr1vf4mk61l3jsx5mdk7k5538 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node07qoulp8nn5xv131hpxdx66jxw559 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01vii4hgayrvrj1vz2onnm0f5cm528 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01o2xidy1nxcylpqudobpfr4ew554 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01qvhsj6qnnws21l2qac9cqosve524 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0y130dxwonbunkrjwn0qrmloo552 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node014oy7ot1eag6hm8qggrfbmf1i523 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0ba5brfgpa29yaujsj0gfmwf1526 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0xsbvztvl697l1wn6y01f2jnjl536 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01mbmsernlx4yj6es0eeyxnf7t537 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0wlj4b32hvi1zbyqstdo0x352550 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node010vpn7hnickq0l3x31jx30jhy558 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01cnyqrjl5825m14e8857auiifb534 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node01m2m57yopo16olto4x8lgou0h530 2021-04-14T13:40:34.643Z [Scheduler-712609105-1] INFO o.o.p.c.o.l.PortalTimeoutHandler Session getting destroyed - id: node0a98juvpi354xevoshxbn38zx535 2021-04-14T13:40:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf0002f-283c-4386-83c4-cc9ab3dc4e8a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf0002f-283c-4386-83c4-cc9ab3dc4e8a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2229dc88 2021-04-14T13:40:35.802Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf0002f-283c-4386-83c4-cc9ab3dc4e8a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:35.803Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=faf0002f-283c-4386-83c4-cc9ab3dc4e8a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:36.225Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=429ccea3-cf9b-43db-9dd3-3c0fa336e370 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:40:36.224964Z InvocationID=c22bc0f1-b537-48d0-9319-fa83f4ab3b63 LogTimestamp=2021-04-14T13:40:36.225026Z Entering 2021-04-14T13:40:36.225Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=429ccea3-cf9b-43db-9dd3-3c0fa336e370 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:40:36.224964Z InvocationID=c22bc0f1-b537-48d0-9319-fa83f4ab3b63 LogTimestamp=2021-04-14T13:40:36.225026Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:40:36.227Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:40:36.225Z InvocationID=3ebbfb8e-3ce4-4625-a51b-6287b6fe0471 LogTimestamp=2021-04-14T13:40:36.227268Z ResponseDesc=OK Exiting. 2021-04-14T13:40:36.227Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:40:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346124c-b753-4c4f-837e-79976708880a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346124c-b753-4c4f-837e-79976708880a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7c6d426c 2021-04-14T13:40:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346124c-b753-4c4f-837e-79976708880a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:38.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f346124c-b753-4c4f-837e-79976708880a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca258b9-142d-4a3c-83ff-750a785a1a42 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca258b9-142d-4a3c-83ff-750a785a1a42 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@344a1a8 2021-04-14T13:40:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca258b9-142d-4a3c-83ff-750a785a1a42 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:41.607Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=6ca258b9-142d-4a3c-83ff-750a785a1a42 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28974bda-e805-44ac-8f0f-1ef266fcf1ff PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:45.125Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28974bda-e805-44ac-8f0f-1ef266fcf1ff PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@73b91f1f 2021-04-14T13:40:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28974bda-e805-44ac-8f0f-1ef266fcf1ff PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:45.126Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=28974bda-e805-44ac-8f0f-1ef266fcf1ff PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:46.187Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:46.189Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:40:46.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:40:47.985Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee54b459-01b3-4773-9773-9aa954b5a071 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee54b459-01b3-4773-9773-9aa954b5a071 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f98507c 2021-04-14T13:40:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee54b459-01b3-4773-9773-9aa954b5a071 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:47.986Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ee54b459-01b3-4773-9773-9aa954b5a071 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c15e23e-6281-49e8-a144-221c332afb53 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c15e23e-6281-49e8-a144-221c332afb53 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@9f00fc1 2021-04-14T13:40:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c15e23e-6281-49e8-a144-221c332afb53 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:51.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=7c15e23e-6281-49e8-a144-221c332afb53 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0482f76e-f075-4195-aaae-d881e9217571 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0482f76e-f075-4195-aaae-d881e9217571 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f9fa6b6 2021-04-14T13:40:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0482f76e-f075-4195-aaae-d881e9217571 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:53.944Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0482f76e-f075-4195-aaae-d881e9217571 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e77639-a467-4d94-a7fb-af1c445350aa PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e77639-a467-4d94-a7fb-af1c445350aa PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@14e505bd 2021-04-14T13:40:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e77639-a467-4d94-a7fb-af1c445350aa PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:56.846Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=16e77639-a467-4d94-a7fb-af1c445350aa PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:40:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac4f3c73-7416-4ed6-bccd-8340a013249c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:40:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac4f3c73-7416-4ed6-bccd-8340a013249c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4923aced 2021-04-14T13:40:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac4f3c73-7416-4ed6-bccd-8340a013249c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:40:59.536Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ac4f3c73-7416-4ed6-bccd-8340a013249c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:01.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:01.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9826ada-2f97-4759-8864-58dd626475de PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9826ada-2f97-4759-8864-58dd626475de PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40243c0f 2021-04-14T13:41:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9826ada-2f97-4759-8864-58dd626475de PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:02.825Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e9826ada-2f97-4759-8864-58dd626475de PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:41:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:41:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:41:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:41:04.352Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:41:04.353Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:41:05.993Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e05abdd1-d6d9-4f4b-9c37-8e2db33d8ebe PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:05.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e05abdd1-d6d9-4f4b-9c37-8e2db33d8ebe PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@125c88ab 2021-04-14T13:41:05.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e05abdd1-d6d9-4f4b-9c37-8e2db33d8ebe PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:05.994Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e05abdd1-d6d9-4f4b-9c37-8e2db33d8ebe PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:06.238Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9d7267b0-d322-44e0-8cce-5e0d5e40149e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:06.237741Z InvocationID=c63a2990-dc09-43e0-b9b4-9dbcbb114299 LogTimestamp=2021-04-14T13:41:06.237869Z Entering 2021-04-14T13:41:06.238Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9d7267b0-d322-44e0-8cce-5e0d5e40149e InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:06.237741Z InvocationID=c63a2990-dc09-43e0-b9b4-9dbcbb114299 LogTimestamp=2021-04-14T13:41:06.237869Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:41:06.241Z [qtp580718781-18] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:41:06.239Z InvocationID=d02d7ee2-46d0-469d-852a-6211be8ead4b LogTimestamp=2021-04-14T13:41:06.241450Z ResponseDesc=OK Exiting. 2021-04-14T13:41:06.241Z [qtp580718781-18] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:41:08.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5420cd15-a624-4ffb-9022-d11f7e8b17ed PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:08.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5420cd15-a624-4ffb-9022-d11f7e8b17ed PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2ea8bfb0 2021-04-14T13:41:08.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5420cd15-a624-4ffb-9022-d11f7e8b17ed PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:08.996Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5420cd15-a624-4ffb-9022-d11f7e8b17ed PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:12.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f2fd237-0ff2-4552-a6a4-0f03608e67c7 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:12.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f2fd237-0ff2-4552-a6a4-0f03608e67c7 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7a382a4c 2021-04-14T13:41:12.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f2fd237-0ff2-4552-a6a4-0f03608e67c7 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:12.153Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0f2fd237-0ff2-4552-a6a4-0f03608e67c7 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddf3e8d-1a98-4a8a-b9ab-09b63d10ca1f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddf3e8d-1a98-4a8a-b9ab-09b63d10ca1f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1b9da540 2021-04-14T13:41:14.702Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddf3e8d-1a98-4a8a-b9ab-09b63d10ca1f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:14.703Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=0ddf3e8d-1a98-4a8a-b9ab-09b63d10ca1f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:16.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:16.194Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:16.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38ba9c26-ce0a-41eb-9786-69fde4a8fdef PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38ba9c26-ce0a-41eb-9786-69fde4a8fdef PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6df26f48 2021-04-14T13:41:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38ba9c26-ce0a-41eb-9786-69fde4a8fdef PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:18.084Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=38ba9c26-ce0a-41eb-9786-69fde4a8fdef PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fe92e0-50a6-4bec-b56f-65d14cedc823 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:20.543Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fe92e0-50a6-4bec-b56f-65d14cedc823 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@64c0879 2021-04-14T13:41:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fe92e0-50a6-4bec-b56f-65d14cedc823 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:20.544Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5fe92e0-50a6-4bec-b56f-65d14cedc823 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ae23d4-182e-4655-81cf-f1ffbdb9d017 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ae23d4-182e-4655-81cf-f1ffbdb9d017 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3d9d38b6 2021-04-14T13:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ae23d4-182e-4655-81cf-f1ffbdb9d017 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:24.112Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e7ae23d4-182e-4655-81cf-f1ffbdb9d017 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:27.286Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6f43ed-538f-40bc-9d08-929d78f12ae2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:27.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6f43ed-538f-40bc-9d08-929d78f12ae2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4bdc2de0 2021-04-14T13:41:27.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6f43ed-538f-40bc-9d08-929d78f12ae2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:27.287Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9f6f43ed-538f-40bc-9d08-929d78f12ae2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:29.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6f2f2f-7acb-4164-b225-6e60be83a40b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:29.981Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6f2f2f-7acb-4164-b225-6e60be83a40b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@35aa93fc 2021-04-14T13:41:29.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6f2f2f-7acb-4164-b225-6e60be83a40b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:29.982Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fd6f2f2f-7acb-4164-b225-6e60be83a40b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:31.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:31.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:31.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33923b7b-fa39-4726-9e11-395e6373fdea PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33923b7b-fa39-4726-9e11-395e6373fdea PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@53435af0 2021-04-14T13:41:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33923b7b-fa39-4726-9e11-395e6373fdea PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:32.932Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=33923b7b-fa39-4726-9e11-395e6373fdea PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:35.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4565b077-9434-4825-8417-9626a048ab46 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:35.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4565b077-9434-4825-8417-9626a048ab46 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7cf90a6 2021-04-14T13:41:35.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4565b077-9434-4825-8417-9626a048ab46 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:35.786Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4565b077-9434-4825-8417-9626a048ab46 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:36.208Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=9e1256fc-566d-40d3-8f49-b7e0383106db InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:36.207778Z InvocationID=9efaa275-23e2-47f0-90c1-27022f857f0c LogTimestamp=2021-04-14T13:41:36.207832Z Entering 2021-04-14T13:41:36.208Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=9e1256fc-566d-40d3-8f49-b7e0383106db InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.5.37 StatusCode=INPROGRESS userId=null RemoteHost=10.242.5.37 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:36.207778Z InvocationID=9efaa275-23e2-47f0-90c1-27022f857f0c LogTimestamp=2021-04-14T13:41:36.207832Z localAddr=10.242.62.146 remoteAddr=10.242.5.37 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:41:36.209Z [qtp580718781-16] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:41:36.208Z InvocationID=a295ce38-7747-4b2d-83c4-e9da0b9c1c03 LogTimestamp=2021-04-14T13:41:36.209811Z ResponseDesc=OK Exiting. 2021-04-14T13:41:36.210Z [qtp580718781-16] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:41:36.216Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=eb56d2c4-7c10-47cc-beb1-a11912457040 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:36.216156Z InvocationID=69436a81-2614-48ea-a441-446c4caeced2 LogTimestamp=2021-04-14T13:41:36.216168Z Entering 2021-04-14T13:41:36.216Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=eb56d2c4-7c10-47cc-beb1-a11912457040 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:36.216156Z InvocationID=69436a81-2614-48ea-a441-446c4caeced2 LogTimestamp=2021-04-14T13:41:36.216168Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:41:36.216Z [qtp580718781-11] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=0 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:41:36.216Z InvocationID=8a563b5a-4f16-488d-9032-bd2ea89c811f LogTimestamp=2021-04-14T13:41:36.216826Z ResponseDesc=OK Exiting. 2021-04-14T13:41:36.217Z [qtp580718781-11] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:41:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9828e349-ad12-4b62-a46d-a3c20c56eeb1 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9828e349-ad12-4b62-a46d-a3c20c56eeb1 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2d560e92 2021-04-14T13:41:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9828e349-ad12-4b62-a46d-a3c20c56eeb1 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:39.097Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=9828e349-ad12-4b62-a46d-a3c20c56eeb1 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989570fc-1342-472f-9f0d-e2919a4056be PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989570fc-1342-472f-9f0d-e2919a4056be PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4c024db7 2021-04-14T13:41:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989570fc-1342-472f-9f0d-e2919a4056be PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:41.547Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=989570fc-1342-472f-9f0d-e2919a4056be PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:45.017Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8eaac-2b36-44a9-b348-15ed2ee66a72 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8eaac-2b36-44a9-b348-15ed2ee66a72 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@55f0a1d 2021-04-14T13:41:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8eaac-2b36-44a9-b348-15ed2ee66a72 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:45.018Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=14c8eaac-2b36-44a9-b348-15ed2ee66a72 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:46.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:46.196Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:46.197Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:41:46.199Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:41:48.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10e554ec-3abf-45ed-bf5e-f7d10e9a8ce4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:48.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10e554ec-3abf-45ed-bf5e-f7d10e9a8ce4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@7e6ef0b0 2021-04-14T13:41:48.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10e554ec-3abf-45ed-bf5e-f7d10e9a8ce4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:48.001Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=10e554ec-3abf-45ed-bf5e-f7d10e9a8ce4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:48.235Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=8fbf710f-caa2-4f19-b30e-0d7b59fb86d4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:48.235024Z InvocationID=ef9c8515-28b9-497c-a91b-788b4020b884 LogTimestamp=2021-04-14T13:41:48.235089Z Entering 2021-04-14T13:41:48.235Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=8fbf710f-caa2-4f19-b30e-0d7b59fb86d4 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=clamp auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.228.190 StatusCode=INPROGRESS userId=null RemoteHost=10.242.228.190 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:41:48.235024Z InvocationID=ef9c8515-28b9-497c-a91b-788b4020b884 LogTimestamp=2021-04-14T13:41:48.235089Z localAddr=10.242.62.146 remoteAddr=10.242.228.190 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:41:48.236Z [qtp580718781-15] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.13 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:41:48.235Z InvocationID=c83599ed-17da-4da4-a6c6-6e8fa10f434b LogTimestamp=2021-04-14T13:41:48.236741Z ResponseDesc=OK Exiting. 2021-04-14T13:41:48.237Z [qtp580718781-15] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:41:51.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4931aa11-563f-414f-a274-c90de575690f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:51.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4931aa11-563f-414f-a274-c90de575690f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@63d15371 2021-04-14T13:41:51.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4931aa11-563f-414f-a274-c90de575690f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:51.031Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4931aa11-563f-414f-a274-c90de575690f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:53.839Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=353df803-1bf7-4682-8235-12ac4d071252 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=353df803-1bf7-4682-8235-12ac4d071252 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3de0c549 2021-04-14T13:41:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=353df803-1bf7-4682-8235-12ac4d071252 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:53.840Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=353df803-1bf7-4682-8235-12ac4d071252 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:56.829Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e06808-b8cf-4b27-b764-6d3c302dcc2c PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e06808-b8cf-4b27-b764-6d3c302dcc2c PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@40922f0a 2021-04-14T13:41:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e06808-b8cf-4b27-b764-6d3c302dcc2c PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:56.830Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=35e06808-b8cf-4b27-b764-6d3c302dcc2c PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:41:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68ae0a-b7ac-4a44-80a3-7ad1b993e707 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:41:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68ae0a-b7ac-4a44-80a3-7ad1b993e707 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@49f0bcd8 2021-04-14T13:41:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68ae0a-b7ac-4a44-80a3-7ad1b993e707 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:41:59.550Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ce68ae0a-b7ac-4a44-80a3-7ad1b993e707 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:01.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:01.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:01.190Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:01.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:02.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf6343e9-0418-485c-945b-b50f413f2a3f PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:02.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf6343e9-0418-485c-945b-b50f413f2a3f PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2053344c 2021-04-14T13:42:02.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf6343e9-0418-485c-945b-b50f413f2a3f PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:02.935Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=bf6343e9-0418-485c-945b-b50f413f2a3f PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:04.350Z [TopicPollingThread-1] INFO c.a.n.c.c.impl.CambriaConsumerImpl RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling UEB GET /events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 2021-04-14T13:42:04.350Z [TopicPollingThread-1] WARN c.a.nsa.apiClient.http.HostSelector RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling All hosts were blacklisted; reverting to full set of hosts. 2021-04-14T13:42:04.351Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 will send credentials over a clear channel. 2021-04-14T13:42:04.351Z [TopicPollingThread-1] INFO c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling GET http://message-router.onap:3904/events/SDC-DISTR-STATUS-TOPIC-AUTO/sdc-AUTO/sdc-AUTO1?timeout=15000 (as iPIxkpAMI8qTcQj8) ... 2021-04-14T13:42:04.353Z [TopicPollingThread-1] WARN c.att.nsa.apiClient.http.HttpClient RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=200 TargetEntity=fetchFromTopic Connection problem towards U-EB server. Reason: 500 2021-04-14T13:42:04.354Z [TopicPollingThread-1] ERROR o.o.s.c.config.EcompErrorLogUtil alarmSeverity=MAJOR RequestID=null ErrorCategory=ERROR ServiceName=fetchFromTopic TargetServiceName=null ErrorCode=500 TargetEntity=distributionEngineStatusPolling Error occured during access to U-EB Server. Operation: failed to fetch messages from topic SDC-DISTR-STATUS-TOPIC-AUTO error: CambriaErrorResponse [operationStatus=CONNNECTION_ERROR, httpCode=500, variables=[]] 2021-04-14T13:42:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a41c766-dd5e-49a4-b572-607c52bd90c4 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a41c766-dd5e-49a4-b572-607c52bd90c4 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1ba27782 2021-04-14T13:42:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a41c766-dd5e-49a4-b572-607c52bd90c4 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:06.183Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4a41c766-dd5e-49a4-b572-607c52bd90c4 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:06.229Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=5f778534-1819-4de1-ab16-68c9797be43f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:42:06.228814Z InvocationID=1dee6e69-5dae-4f30-b49f-0a628c14f314 LogTimestamp=2021-04-14T13:42:06.228856Z Entering 2021-04-14T13:42:06.229Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=5f778534-1819-4de1-ab16-68c9797be43f InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:42:06.228814Z InvocationID=1dee6e69-5dae-4f30-b49f-0a628c14f314 LogTimestamp=2021-04-14T13:42:06.228856Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:42:06.230Z [qtp580718781-13] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=1 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:42:06.229Z InvocationID=2e48a9b2-96c7-46e1-8846-944209a34ee3 LogTimestamp=2021-04-14T13:42:06.230126Z ResponseDesc=OK Exiting. 2021-04-14T13:42:06.231Z [qtp580718781-13] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:42:08.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3d45410-233d-4020-842f-89bebfb4a921 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:08.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3d45410-233d-4020-842f-89bebfb4a921 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4a99e183 2021-04-14T13:42:08.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3d45410-233d-4020-842f-89bebfb4a921 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:08.902Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=c3d45410-233d-4020-842f-89bebfb4a921 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:12.209Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f232bcc6-3d28-490b-9003-ecf0cf1d4060 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f232bcc6-3d28-490b-9003-ecf0cf1d4060 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6c39274 2021-04-14T13:42:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f232bcc6-3d28-490b-9003-ecf0cf1d4060 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:12.210Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f232bcc6-3d28-490b-9003-ecf0cf1d4060 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2d077cc-b70e-4cbe-885c-e65737f3a93a PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:14.696Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2d077cc-b70e-4cbe-885c-e65737f3a93a PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@3f8b27b4 2021-04-14T13:42:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2d077cc-b70e-4cbe-885c-e65737f3a93a PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:14.697Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=e2d077cc-b70e-4cbe-885c-e65737f3a93a PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:16.189Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:16.190Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:16.191Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:16.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:18.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aeb535d-ae21-42fa-8c54-85ec882d0af5 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:18.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aeb535d-ae21-42fa-8c54-85ec882d0af5 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@379d59a0 2021-04-14T13:42:18.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aeb535d-ae21-42fa-8c54-85ec882d0af5 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:18.090Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=5aeb535d-ae21-42fa-8c54-85ec882d0af5 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f246fd3-116b-4573-8011-7281eacb66c0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f246fd3-116b-4573-8011-7281eacb66c0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@320d3329 2021-04-14T13:42:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f246fd3-116b-4573-8011-7281eacb66c0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:20.549Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=3f246fd3-116b-4573-8011-7281eacb66c0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b18680-3722-4ec9-9686-f9094dcb028e PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b18680-3722-4ec9-9686-f9094dcb028e PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28c7572e 2021-04-14T13:42:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b18680-3722-4ec9-9686-f9094dcb028e PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:24.122Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=18b18680-3722-4ec9-9686-f9094dcb028e PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:27.180Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab6208c4-59c0-4b52-9a93-5b075458ff7b PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab6208c4-59c0-4b52-9a93-5b075458ff7b PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@4e177305 2021-04-14T13:42:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab6208c4-59c0-4b52-9a93-5b075458ff7b PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:27.181Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ab6208c4-59c0-4b52-9a93-5b075458ff7b PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdc78b59-4e97-479e-838f-49acef7fcb10 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdc78b59-4e97-479e-838f-49acef7fcb10 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@139a633e 2021-04-14T13:42:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdc78b59-4e97-479e-838f-49acef7fcb10 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:30.029Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=fdc78b59-4e97-479e-838f-49acef7fcb10 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:31.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:31.192Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:31.193Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:31.194Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:32.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb2bfb1-8958-4e1d-9707-b512ca95fbe2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:32.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb2bfb1-8958-4e1d-9707-b512ca95fbe2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@48558e1f 2021-04-14T13:42:32.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb2bfb1-8958-4e1d-9707-b512ca95fbe2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:32.912Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=ffb2bfb1-8958-4e1d-9707-b512ca95fbe2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2d64c-5f44-44f4-bc18-be437ec59648 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2d64c-5f44-44f4-bc18-be437ec59648 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@5ab9de1c 2021-04-14T13:42:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2d64c-5f44-44f4-bc18-be437ec59648 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:35.893Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=72f2d64c-5f44-44f4-bc18-be437ec59648 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:36.245Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter RequestID=4d54c977-997e-4474-be0b-348ca64cb483 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:42:36.244612Z InvocationID=02482b52-5b95-4013-80e5-776fde778502 LogTimestamp=2021-04-14T13:42:36.244690Z Entering 2021-04-14T13:42:36.245Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=4d54c977-997e-4474-be0b-348ca64cb483 InstanceID=29dda665-5fdf-4c1f-a5ee-0dfd01fa4a2f ElapsedTime=0 Severity=0 PartnerName=multicloud auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m ClientIPAddress=10.242.62.156 StatusCode=INPROGRESS userId=null RemoteHost=10.242.62.156 ServerIPAddress=10.242.62.146 ServiceName=v1/artifactTypes ServiceInstanceID=null EntryTimestamp=2021-04-14T13:42:36.244612Z InvocationID=02482b52-5b95-4013-80e5-776fde778502 LogTimestamp=2021-04-14T13:42:36.244690Z localAddr=10.242.62.146 remoteAddr=10.242.62.156 GET /sdc/v1/artifactTypes HTTP/1.1 2021-04-14T13:42:36.247Z [qtp580718781-17] INFO o.o.l.f.base.AbstractAuditLogFilter ResponseCode=200 RequestID=null ElapsedTime=2 PartnerName=Apache-HttpClient/4.5.7 (Java/11.0.8) auditOn=true ServerFQDN=dev-sdc-be-59c76dbb57-hpl5m StatusCode=COMPLETE ServerIPAddress=10.242.62.146 ServiceName=/v1/artifactTypes EntryTimestamp=2021-04-14T13:42:36.245Z InvocationID=caae7833-6253-4e37-8bf4-3edcbdaf0dfc LogTimestamp=2021-04-14T13:42:36.247672Z ResponseDesc=OK Exiting. 2021-04-14T13:42:36.247Z [qtp580718781-17] INFO o.o.sdc.be.filters.BeServletFilter RequestID=null GET /sdc/v1/artifactTypes HTTP/1.1 SC="200" 2021-04-14T13:42:39.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54a4472-94b4-4ab5-87cb-2953d05c3b69 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:39.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54a4472-94b4-4ab5-87cb-2953d05c3b69 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@2f431115 2021-04-14T13:42:39.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54a4472-94b4-4ab5-87cb-2953d05c3b69 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:39.087Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=f54a4472-94b4-4ab5-87cb-2953d05c3b69 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32c49f80-c4d5-485c-8437-e03aaf71792d PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32c49f80-c4d5-485c-8437-e03aaf71792d PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@6f001450 2021-04-14T13:42:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32c49f80-c4d5-485c-8437-e03aaf71792d PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:41.568Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=32c49f80-c4d5-485c-8437-e03aaf71792d PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a50635-597f-4a0a-957a-421301e19cb0 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a50635-597f-4a0a-957a-421301e19cb0 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@bc14ad9 2021-04-14T13:42:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a50635-597f-4a0a-957a-421301e19cb0 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:45.025Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=b5a50635-597f-4a0a-957a-421301e19cb0 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:46.188Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:46.191Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:46.192Z [UEB-Health-Check-Thread] INFO c.att.nsa.apiClient.http.HttpClient GET http://message-router.onap:3904/apiKeys/iPIxkpAMI8qTcQj8 (anonymous) ... 2021-04-14T13:42:46.193Z [UEB-Health-Check-Thread] WARN c.att.nsa.apiClient.http.HttpClient Error executing HTTP request. Connect to message-router.onap:3904 [message-router.onap/10.96.237.223] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-04-14T13:42:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91bf34e9-17fb-43b1-8408-44c7df5898c2 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91bf34e9-17fb-43b1-8408-44c7df5898c2 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@1f9c2c83 2021-04-14T13:42:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91bf34e9-17fb-43b1-8408-44c7df5898c2 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:48.083Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=91bf34e9-17fb-43b1-8408-44c7df5898c2 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b97ef2b-12cb-4b3a-9f5f-322b5adc5655 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b97ef2b-12cb-4b3a-9f5f-322b5adc5655 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@28e04ddc 2021-04-14T13:42:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b97ef2b-12cb-4b3a-9f5f-322b5adc5655 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:51.324Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=4b97ef2b-12cb-4b3a-9f5f-322b5adc5655 PartnerName=SDC.BE The cassandra down nodes number is 0 2021-04-14T13:42:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ff6d2c-fed8-4f1a-9b59-3bdd6e7eae02 PartnerName=SDC.BE creating cluster for Cassandra for monitoring. 2021-04-14T13:42:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ff6d2c-fed8-4f1a-9b59-3bdd6e7eae02 PartnerName=SDC.BE The cassandra session is com.datastax.driver.core.SessionManager@472d7e04 2021-04-14T13:42:53.746Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ff6d2c-fed8-4f1a-9b59-3bdd6e7eae02 PartnerName=SDC.BE The number of cassandra nodes is:3 2021-04-14T13:42:53.747Z [BE-Health-Check-Task] INFO o.o.s.b.c.impl.CassandraHealthCheck RequestID=17ff6d2c-fed8-4f1a-9b59-3bdd6e7eae02 PartnerName=SDC.BE The cassandra down nodes number is 0